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ABSTRACT 

The Educational Testing Service has initiated the 
development of a new series of tests tc be used as part of the 
process states use to license or certify their teachers. Stage I of 
this new generation of tests will determine whether teachers possess 
an acceptable level of competence in the enabling skills the 
beginning teacher requires. This report describes the research study 
that was conducted to identify the enabling skills content domain for 
Stage I assessments. Job analysis was used to identify the core of 
important skills. A domain of skills was defined through literature 
review and advice from experts* The second phase was to verify the 
judgments of content experts through a large-scale survey of 289 
state education officials, 2,269 elementary and secondary school 
teachers, and a supplemental groups of 236 Black and Hispanic 
teachers. Of the 134 defined enabling skills, only 3 were judged to 
be of Ij'ttle or no importance by more than 207. of the teachers, and 
113 were determined to be important by all respondent groups. These 
findings may be used in test construction* Eighteen appendixes 
present supplemental information, including the survey. Twenty-three 
tables present study information. (Contains 25 references.) (SLD) 
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IDENTIFICATION OF A CORE OF IMPORTANT ENABLING SKILLS 
FOR THE NTE SUCCESSOR STAGE I EXAMINATION 

Executive Summary 

Michael Rosenfeld and Richard J. Tannenbaum 

Introduction 

In light of recent national debates about the preparedness and effectiveness of teachers, 
and advances in measurement, psychological and educational research, and technology. 
Educational Testing Service (ETS) has initiated the development of a new teacher assessment 
system. This new assessment system is designed to be used as part of the process iniplemented 
by states to license or certify their teachers. This new generation of tests wiU consist of three 
stages. The Stage I tests are designed to be used by a state to decide whether prospective 
teachers possess an acceptable level of competence in the enabling skills the state requires of 
the beginning teacher. These may be conceptualized as those skills (e.g., reading, writing, and 
mathematics) that serve as the foundation for teacher development and practice and are judged 
to be important for teachers regardless of school level or subject matter taught. The Stage n 
tests win measure subject-matter knowledge, pedagogy, and, in some disciplines, subject-matter 
pedagogy. Included among these tests are the Spanish examination for Spanish teachers, the 
Mathematics examination for mathematics teachers, and the Physics examination for Physics 
teachers. Stage III tests wiU measure the beginning teacher's knowledge and application of 
pedagogy (Dwyer, 1989). 

This report describes the research study that was conducted to identify the enabling skills 
content domain to be considered for the Stage I assessment measures. The purpose of this 
study was to define a domain of enabling skills that a wide range of practicing professionals 
(e.g., teachers, administrators, principals, state department of education officials) and school- 
related community groups (e.g.. National Parent Teacher Association) believed were important 
for all entry-level teachers regardless of school level or subject matter taught. The objective was 
to provide test development committees with a core of enabling skills that all relevant groups 
agreed were important for all entry-level teachers. This identified core would then serve as the 
content pool from which the Stage I test specifications would be developed. 

Method 

Job analysis was used to identify the core of important enabling skills. It consisted of 
two major phases. The first phase was designed to define a domain of important enabling skills. 
This was accomplished through literature reviews, interviews with members of relevant 
constituencies, and committees of content experts. The second phase was designed to verify the 
judgments of the content experts and to identify a core of important enabling skills relevant for 
all entry-level teachers. This verification was accomplished through a large-scale survey 
administration of the enabling skills domain to practicing teachers and constituent groups who 
were asked to judge the importance of each enabling skill for all entry-level teachers regardless 
of subject matter or grade taught. These two phases are described below. 
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Phase I: De finition of a Domain of Important Enabling Skills 



Step 1 . A preliminary description of an enabling skills domain was constructed by ETS 
Test Development staff. This draft was the product of reviews of relevant professional 
literature, existing examinations dealing with teaching skills, enabling skills required by various 
states as part of their licensing requirements, and Test Development staffs' own expertise in the 
field of teaching and teacher assessment. This draft description consisted of 119 specific 
enabling skills clustered within five dimensions: (1) Reading, (2) Writing, 
(3) Mathematics, (4) Listening, and (5) Speaking. 

Step 2 . This preliminary domain description was reviewed by an External Review Panel 
of 21 practicing professionals. These professionals were teachers, principals, deans or associate 
deans of education, state directors of teacher education and certification, and state 
representatives from the National Parent Teacher Association. These individuals were 
recommended by their respective professional associations. They were asked to review the draft 
domain in terms of the adequacy of its overall structure and the relevance of the specific 
enabling skills for all entry-level teachers. They were also asked to add and/or delete enabling 
skills as they believed to be necessary in order to appropriately define the enabling skills 
domain. Their comments were obtained through telephone interviews. The draft was revised 
based on those comments. 

Step 3 . The revised draft description was then reviewed by a 12 member National 
Advisory Conmiittee. The members of this committee were selected from the same 
constituencies that comprised the External Review Panel and had representation by sex, race, 
and geographic region. The members of the committee were mailed the draft description and 
asked to review it and to be prepared to discuss their revisions during a two^iay meeting at 
ETS. The goal of the meeting was to obtain consensus of what, in their expert opinions, 
constituted a domain of important enabling skills relevant for all entry-level teachers. In 
addition tc minor structural changes, one new dimension was added to the enabling skills 
domain. Interactive Communication Skills. The resulting domain of important enabling skills 
was then verified through a large-scale survey by several thousand practicing professionals 
including teachers and representatives of various constituencies. 

Phase n: Identification o f the Core of Important Enabling Skills for Entrv-Levei Teachers 

Survey methodology was used to verify the judgments of the committees of content 
experts and identify the core of important enabling skUls from within the defined content 
domain. 

Importance Rating Scale . In accordance with established professional standards 
(see Principles for the Validation and Use of Personnel Selection Procedures, 1987; Standards 
for Educational and Psychological Testing, 1985), an importance scale was used in the survey to 
evaluate the enabling skills of the content domain. The scale is presented below. Comparable 
5-point-anchor descriptors have been used in other job analytic studies (see Schneider & Konz, 
1989; Silvestro, Clayton, & Glenn, 1989). This scale was reviewed and approved by the National 
Advisory Committee. 
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Regardless of the subject-matter area or grade they teach, how important is it 
that all entiy-level teachers be able to do the following? 

(1) Of no importance 

(2) Of little importance 

(3) Moderately important 

(4) Very important 

(5) Extremely important 

Pilot Test . Prior to the large scale administration of the job analysis survey, it was pilot 
tested on six experienced teachers (two elementary, two middle, and two secondary) in the New 
Jersey and Pennsylvania areas. The pilot test was conducted to determine if the content of the 
survey was clear and understandable and if the survey instructions and format needed to be 
modified. A copy of the survey was mailed to the teachers, and ^heir comments were obtained 
via a telephone interview conducted by an ETS staff member. Revisions to the survey 
instrument were made based upon the feedback of the pilot test participants. 

Final Survey Format . The final version of the survey consisted of three parts. Part I 
included the enabling skills that were to be rated using the importance scale. This section 
consisted of 134 enabling skill statements clustered within six dimensions: (1) Reading, 
(2) Writing, (3) Mathematics, {^) Listening, (5) Speaking, and (6) Interactive Communication 
Skills. Also included in Part I was a section that provided respondents with the opportunity to 
add additional dimensions and specific enabling skills they believed should have been included in 
the survey and a section that asked respondents to indicate how well the enabling skills within 
each of the six dimensions were covered in the survey. Part n was designed to obtain 
respondent judgments as to how much emphasis they believed the examination should place on 
each of the six enabling skill dimensions. Part III was comprised of demographic descriptors 
that were used to characterize the survey respondents and, where appropriate, to conduct 
subgroup analyses (Le., do the different demographic groups of respondents agree in their 
ratings of enabling skill importance). 

Survey Participants 

Three groups of practicing professionals were selected for participation in the survey: 
(1) state officials from 10 constituencies involved in teaching, teacher education, licensing and 
certification, and school-related community organizations (n-289); (2) elementary, middle, and 
secondary school teachers from each of the 50 states and the District of Columbia (n* 2,269); 
and (3) a supplementary group of Black and Hispanic teachers (included to ensure adequate 
minority representation) from the elementary, middle, and i^econdary school levels (n«236). 

Survev Administration 

The surveys were administered during the months of May 1989 through January 1990. 
Each survey was accompanied by a postage-paid return envelope and a letter of invitation to 
participate tn the survey. Each survey administration was followed, within approximately one 
week, by a postcard reminding the participants to complete and return the survey. 
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Frequency distributions of importance ratings were computed for each enabling skill by 
the three respondent groups to determine the percent of respondents who judged each enabling 
skill to be of little importance (scale value of 2) or of no importance (scale value of 1). Mean 
importance ratings were also computed for each enabling skill by the three respondent groups 
and by relevant subgroups of teachers. The subgroup analyses were conducted to determine if 
the judged importance of the enabling skills differed by relevant subgroups of teachers 
(e.g^ male and female; Hispanic and White). It was decided by ETS staff that to be considered 
eligible for inclusion in the Stage I assessment measures, fewer than 20% of the respondents 
should judge an enabling skill to be of little importance or of no importance, and its mean 
importance rating should be at least 3,50 (the midpoint between moderately important and very 
important). The reliability of the importance ratings of the three respondent groups was also 
computed Finally, profiles of mean importance ratings were correlated to determine the extent 
to which the three respondent groups and the relevant subgroups of teachers agreed in their 
perceptions of the relative importance of the enabling skills. 

Results 

Frequency Analyses 

Across all three groups of respondents, only 3 of the 134 enabling skiQs (less than 3% of 
the domain) were judged to be of little or no importance by more than 20% of the respondents. 
Therefore, according to the frequency standard, approximately 98% of the enabling skiUs 
domain may be considered to be eligible for inclusion in the Stage I assessment measures. 

Mean Analyses 

Across all three groups of respondents, only 6 of the 134 enabling skills (less than 5% of 
the domain) had a mean importance rating of less than 3^0. In addition to the mean analysis at 
the aggregate level of the respondent groups, analyses were conducted for teachers by: (1) sex, 
(2) race/ethnicity, (3) school setting, (4) school level, (5) teaching experience, (6) subject taught, 
and (7) geographic region. These subgroup analyses revealed 15 additional enabling skills that 
had a mean importance rating of less than 3.50. In total, 21 of the 134 enabling skills had a 
mean importance rating of less than 3J50. (These 21 enabling skills subsumed the three skills 
"flagged" by the frequency analysis described above.) Therefore, approximately 84% of the 
enabling skills domain may be considered to be eligible for inclusion in the Stage I assessment 
measures. 

Reliability of Importance Ratings 

Group split half correlations and intraclass correlations were computed for the mean 
ratings of the three groups of respondents. For each of the respondent groups both reliability 
estimates exceeded .96, indicating that the mean importance ratings are extremely reliable. 



Agreement in the Relative Importance of the Enabling Skills 



Correlations of the profiles of the 134 mean importance ratings for the three respondent 
groups and relevant subgroups of teachers were computed. The subgroups of teachers were 
defined by: (1) sex (male and female); (2) race/ethnicity (Black, White, and Hispanic); 
(3) school setting (urban, suburban, and rural); (4) school level (elementary, middle, and 
secondary); (5) teaching experience (<. 5 yrs, 6-10 yrs, 11-15 yrs, >. 16 yrs); (6) subjfxts taught 
(business and vocational education, social sciences, physical and biological sciences, mathematics 
and computer science, language arts, and special education); and (7) geographic region (Far 
West, Southern, Central, and Northeast). High correlations across the three respondent groups 
and within each of subgroups of teachers indicate agreement with respect to the distributions of 
the mean importance ratings (i.e., relative importance). In aU but two instances the correlations 
exceeded .90. This indicates that the three respondent groups and all teachers, regardless of sex, 
ethnicity, school setting, school level, subject taught, and geographic region, agreed in their 
perceptions of the relative importance of the enabling skills. 

Conclusions 

The purpose of this study was to identify a core of important enabling skills for entry- 
level teachers on which there is substantial agreement by practicing teachers and constituent 
groups. This core would be used to assist in the development of the Stage I assessment 
measures. The results of this study clearly indicate that 84% of the enabling skills domain (113 
out of 134 enabling skills) was judged to be important by aU three respondent groups and by all 
subgroups of teachers. TTiese findings may be used to support the development of a single Stage 
I assessment measure that is appropriate for aU candidates regardless of sex, race/ethnicity, 
school setting, school level, subject taught, and geographic region. 
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IDENTinCATION OF A CORE OF IMPORTANT ENABLING SKILLS 
FOR THE NTE SUCCESSOR STAGE I EXAMINATION 



Introduction 

In light of recent national debates about the preparedness aiid effectiveness of teachers, 
and advances in measurement, psychological and educational research, and technology. 
Educational Testing Service (ETS) has initiated the development of a new teacher assessment 
system. This new assessment system is designed to be used as part of the process implemented 
by states to license or certify their teachers. This new generation of tests will consist of three 
stages. The Stage I tests are designed to be used by a state to decide whether prospective 
teachers possess an acceptable level of competence in the enabling skills the state requires of 
the beginning teacher. These may be conceptualized as those skills (e.g., reading, writing, and 
mathematics) that serve as the foundation for teacher development and practice and are judged 
to be important for teachers regardless of school level or subject matter taught. The Stage 11 
tests will measure subject- matter knowledge, pedagogy, and, in some disciplines, subject-matter 
pedagogy. Included among these tests are the Spanish examination for Spanish teachers, the 
Mathematics examination for mathematics teachers, and the Physics examination for Physics 
teachers. Stage III tests will measure the beginning teacher's knowledge and application of 
pedagogy (Dwyer, 1989). 

This report describes the research study that was conducted to identify the enabling skills 
content domain to be considered for the Stage I assessment measures. The purpose of this 
study was to define a domain of enabling skills that a wide range of practicing professionals 
(e.g., teachers, administrators, principals, state department of educations officials) and school- 
related community gi'oups (e.g.. National Parent Teacher Association) believed were important 
for all entry-level teachers regardless of school level or subject matter taught. The objective was 
to provide test development committees with a core of enabling skills that aU relevant groups 
agreed were important for all entry-level teachers. This identified core would then serve as the 
content pool from which the Stage I test specifications would be developed. 

Method 

The general methodology utilized in this study is commonly referred to as job analysis. 
The objective of job analytic procedures is to define the tasks and/or knowledge, skills, and 
abilities required for a specific job. Job analysis is a critical step in the process of establishing 
the content validity and job-relatedness of assessment measures in general (Schippmann, 
Huglies, & Prien, 1987; Schneider & Konz, 1989; Thompson & Thompson, 1982; Veres, Lahey, 
& Buckly, 1987) and licensing and certification examinations in particular (Mehrens, 1987; 
Shimberg, 1982; Vertiz, 1985). 

The content domain to be covered by a licensure or certification test should 
be defined clearly and explained in terms of the importance of the content for 
competent performance in an occupation. . . . Job analyses provide the 
primary basis for defining the content domain. (Standards for Educational 
and Psychological Testing, 1985, p. 64). 
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The job analysis procedures in this study are being used to aid in the definition of the content 
domain of enabling skills and to serve as one of the bases for documenting the content validity 
of the assessment measures that will be developed from that domain. The evaluation of content 
validity is a judgmental process and is enhanced when multiple judges from relevant areas of 
expertise are represented in the process (Ghiselli, Campbell, & Zedeck, 1981). The procedures 
used in this study emphasized the involvement of large numbers of teachers and other relevant 
constituencies thuroughout the job analysis. 

The job analysis methodology used in the present study consisted of two major phases. 
The first phase was designed to define the domain of important enabling skills. This was 
accomplished throu^ the use of committees of content ejqperts. The second phase was designed 
to: ^1) obtain verification from large numbers of practicing professionals and school-related 
conununity groups that the committees of content experts had, indeed, defined a domain of 
important enabling skills, and (2) identify a core of important enabling skills relevant for all 
entry-level tcadiers. These objectives were accomplished through the use of a large-scale job 
analysis survey that was completed by teachers, principals, administrators, state department of 
education officials, and Parent Teacher Association officials. These two phases will be described 
in this paper. 

Phase I: Definition of the Domain of Important Enabling Skills 

An important step in the process of documenting content validity is defining the domain 
of interest (Guion, 1977). Typically, the content domain is defined by committees of subject- 
matter experts who use open discussion to arrive at a consensus definition of the domain 
(Schmitt & Ostroff, 1986; Schneider & Konz, 1989). In this study, the domain of important 
enabling skills was defined with the involvement of content experts who participated on an 
individual and committee basis. These two approaches facilitated the involvement of large 
numbers of content experts in a cost-effective and efficient manner. The specific steps in these 
approaches are described below. 

Step 1 . A draft description of the enabling skills domain was constructed by ETS Test 
Development staff. Consistent with typical job analytic procedures, several sources of 
information were reviewed in developing the first draft: relevant professional literature, existing 
examinations dealing with teaching skills (e.g., NTE Core Battery, Educational Testing Service, 
1983), existing descriptions of the functions of teachers (see Rosenfeld, Thornton, & Skumik, 
1986), the enabling skills required by various states as part of their licensing requirements, 
and Test Development staffs' own expertise in the field of teaching and teacher assessment. 
The first draft of what was to be the job analysis survey consisted of 119 enabling skill 
statements clustered by ETS Test Development staff into five enabling skill dimensions: 
(1) Reading, (2) Writing, (3) Mathematics, (4) Listening, and (5) Speaking. Writing was 
subdivided into three sections: (1) editing and revising skills, (2) composing skills, and 
(3) integrated communication skills . It was decided at the outset by ETS management that 
characteristics such as dedication, motivation, perseverance, and related personality factors 
(although important to the teaching profession) would not be considered as part of the enabling 
skills domain for this examination because of the difficulty of reliably measuring these qualities. 
This draft instrument was developed as a starting point for defining the domain of enabling 
skills. It was designed to be used as a basis for stimulating discussion with relevant individuals 
and groups outside of ETS. 



Step 2 . The next step in this process involved the identification of an External Review 
Panel to aid in defining the domain of enabling skills (see Appendix A for list of members). 
Their task consisted of the review and critique of the first draft of the enabling skills domain. 
ETS staff members believed that a wide range of professional and community groups having an 
interest in teacher licensure should be involved in the domain definition stage of this project. 
As a result, ETS project staff contacted the following associations: National Education 
Association (NEA), American Federation of Teachers (AFT), National Association of 
Elementary School Principals (NAESP), National Association of Secondary School Principals 
(NASSP), American Association of Colleges for Teacher Education (AACTE), National 
Association of State Directors of Teacher Education and Certification (NASDTEC), and the 
National Parent Teacher Association (NPTA). In each instance, an ETS staff member described 
the project and asked if the association was interested in participating in the project by 
recommending several members of their association to review the first draft of the enabling 
skills domain. All associations agreed to participate. They were requested to recommend 
members who would be willing and able to review and critique the draft domain. In addition, 
they were asked that their members be selected from different regions of the country and have 
representation by gender and race/ethnicity. The NEA and AFT were each asked to provide 
one elementary, one middle, and one secondary school teacher. The NAESP and NASSP were 
each asked to provide one school principal NASDTEC, AACTE, and the NPTA each provided 
the names of five members of their associations. In total, 27 individuals were recommended. 
ETS staff contacted each of the 27 individuals by telephone to confirm their participation. 

The 27 panel members were sent a copy of the draft of the enabling skills domain along 
with a letter describing the project and requesting that they review and critique the draft, and a 
postage-paid return envelope for them to return the draft with their written comments. They 
were asked to review its overall structure (i.e., the dimensionality of the domain) and each 
individual enabling skill statement for its clarity and its relevance to aU teachers. The reviewers 
were also instructed to delete any skill they believed was not an important part of the domain 
and to add any enabling skills they believed were excluded. An ETS staff member called each of 
the reviewers approximately one week after the draft was sent to schedule and then conduct a 
telephone interview to discuss their comments. 

The first draft was revised based on comments made by 21 of the 27 External Review 
Panel members (despite repeated attempts, six members could not be contacted). In general, 
the overall dimensionality of the domain remained the same: no additional dimensions were 
added to the original five, and none of the existing dimensions were deleted. The dimension of 
Reading was subdivided into five sections. These subsections grouped the existing enabling skills 
into related content clusters. This clustering facilitated the interpretation of the Reading 
dimension. The five subsections were: (1) understanding the argument of a reading selection, 
(2) understanding the implied content of a reading selection^ (3) understanding the organization 
of a reading selection. (4) understanding the wav in which language is used in a reading 
SSl^tm and (S) understanding other features of a reading selection. 

Approximately 15 additional skills were included within the dimension of Speaking. 
These skills dealt primarily with the dynamic nature of speaking (e.g., adjust to an unexpected 
change in the communicative situation; exercise good judgment with respect to turn-taking). 
Eight of these IS skills were subsumed under a new subsection of Speaking dealing with 
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interactive communication skills. The resulting second draft consisted of 139 enabling skill 
statements. 



Step 3 . The second draft of enabling skills was reviewed by a 12 person National 
Advisory Committee drawn from members of the same constituencies described in Step 2. ETS 
staff members contacted the associations and asked them to recommend additional members of 
their organizations who they believed would be useful in defining enabling skills, who would 
openly share their views, and who would interact well in a group. The NEA and AFT each 
provided three teachers (one elementary, one middle, one secondary). The NAESP and NASSP 
each provided one school principal NASDTEC and the NPTA each provided one member; the 
AACTE provided two deans of colleges of education. The Committee had representation by 
gender, race/ethnicity, and geographic region (see Appendix B for list of members). The 
members of the National Advisory Committee convened for a two-day meeting at Educational 
Testing Service in Princeton, New Jersey*. The goal of the Committee was to review the second 
draft of the enabling skills domain and to ensure that it accurately represented what they 
considered to be a domain of important enabling skills. 

Committee members were sent a copy of the second draft in the mail two weeks before 
the meeting was to be held. They were told about the purpose of the meeting, asked to review 
the draft, and to come prepared to discuss it with the other members of the Committee. 

The meeting was led by ETS Test Development and Research staff. During the meeting, 
each enabling skill statement was reviewed, and modifications were made based upon the 
consensus judgment of the Committee. Fint, based upon the recommendations of the 
Committee, 4 of the 10 enabling skills from the existing subsection of Reading entitled 
understanding the organization of a reading selection were moved to form an additional 
subsection entitled understanding the content of the reading selection . Second, two new 
dimensions were added to the domain dexription: Interactive Communication Skills and 
Technology. Interactive Communication Skills was formed by combining listing enabling skills 
from the subsection of Writing covering integrated communication with skills from the 
dimension of Speaking, including the subsection dealing with interactive communication. 
Technology consisted of 23 new enabling skills primarily focusing on an understanding of 
computers and computer software. There was some disagreement among the committee 
members concerning the desirability of including this dimension, but it was decided by the 
Committee that it tentatively be included, subject to possible deletion after the committee 
members had an opportunity to review the revised domain following the meeting. The 
Committee also agreed that obtaining views on this matter from an independent group of 
teachers (upon whom the job analysis survey eventually would be pilot tested) would be helpful 
in making the final decision about whether or not to include this dimension In the domain of 
enabling skills. 

One week after the meeting, the revised description was mailed to the members of the 
National Advisory Committee for their final approval. A telephone interview was conducted 



' 7W members of the National Advisory Committee, one dean and the PTA official, were not able to be present at the meeting. Their 
comments were obtained via a ulephone interview. 
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with each member to determine if any further revisions were necessary. No revisions, other 
than some minor wording changes, were suggested. Several members re«emphasized their doubt 
as to whether Technology should remain as part of the content domain. Althou^, they still 
believed it was an important area of understanding, they were less certain that it should be 
considered part of an enabling skill domain that included dimensions such as Reading, Writing, 
and Mathematics. It was decided by the Committee and ETS staff that if the teachers in the 
pilot test (the results of which will be presented in the following sections) confirmed the 
uncertainty ©q^ressed by several of the committee members. Technology would be deleted from 
the enabling skills domain. 

Phase 11: Identification of the Core of Important Enabling SkUls for Entry-Level Teachers 

Survey methodology was used to verify the judgments of the committees of content 
experts and identify the core of important enabling skills from within the defined content 
domain. A survey approach greatly facilitates obtaining the input of large numbers of practicing 
professionals in a timely and cost-effective manner. The involvement of large numbers of 
practicing professionals also permits analyses to be conducted concerning the extent to which 
various subgroups of practicing professionals agree on the importance of the enabling skills 
described in the job analysis survey (e.g., comparisons between teachers from urban, suburban, 
and rural school settings; male and female teachers). The use of survey techniques in job 
analysis is well documented (see Geisinger, 1987; Silvestro, Clayton, & Glenn, 1989; Smith, 
Hambleton, & Rosen, 1988). 

Importance Rating Scale . In accordance with established professional standards 
(see Principles for the Validation and Use of Personnel Selection Procedures, 1987; Standaru. 
for Educational and Psychological Testing, 1985), an importance scale was used in the survey to 
evaluate the enabling skills of the content domain. The scale is presented below. Comparable 
5-point-anchor descriptors have been used in other job analytic studies (see Schneider & Konz, 
1989; Silvestro, Clayton, & Glenn, 1989). This scale was reviewed and approved by the National 
Advisory Committee. 

Regardless of the subject-matter area or grade they teach, how imports t is it 
that all entry-level teachers be able to do the following? 

(1) Of no importance 

(2) Of little importance 

(3) Moderately important 

(4) Very important 

(5) Extremely important 

POot Test . Prior to the large scale administration of the job analysis survey, it was pilot 
tested on six experienced teachers (two elementary, two middle, and two secondary) in the New 
Jersey and Pennsylvania areas (see Appendix C). The pilot test was conducted to determine if 
the content of the survey was clear and understandable and if the survey instructions and format 
needed to be modified. A copy of the survey was mailed to the teachers, and their comments 
were obtained via a telephone interview conducted by an ETS staff member. Although the 
entire survey was reviewed during the interviews, particular attention was direaed towards the 
Technology dimension and whether it was considered to be an enabling skill. The consensus of 



these teachers was that it was not an enabling skill and should be deleted. Like several 
members of the National Advisory Committee, they believed it was important, but not part of 
the enabling skills domain. Based upon this feedback, Technology was deleted from the 
description. The teachers did not have any difficulty understanding or completing the survey. 
On average, the teachers required 45 minutes to complete the survey. 

Final Survev Format . The final version of the survey (included in Appendix D) consisted 
of three parts. In order to encourage participants to respond candidly, no personal identifiers 
(e.g., name, social security number) were required of the respondents. Part I included the 
enabling skills that were to be rated using the importance scale described earlier. This section 
consisted of 134 enabling skiU statements clustered within six dimensions: (1) Reading, 
(2) Writing, (3) Mathematics, (4) Listening, (5) Speaking, and (6) Interactive Communication 
SldUs. Also included in Part I was a section that provided respondents with the opportunity to 
add additional dimensions and specific enabling skills they believed should have been included in 
the survey and a section that asked respondents to indicate how well the enabling skills within 
each of the six dimensions were covered in the survey. Part 11 was designed to obtain 
respondent judgments as to how much emphasis they believed the examination should place on 
each of the six enabling skill dimensions. Part HI was comprised of demographic descriptors 
that were used to characterize the survey respondents and, where appropriate, to conduct 
subgroup analyses (i.e., do the different demographic groups of respondents agree in their 
ratings of enabling skill importance)^ 

Survev Participants 

Three separate groups were involved in the survey phase of this study. The first group 
consisted of state-level representatives from 10 constituencies involved in teaching, teacher 
education, licensure and certification, and school-related community organizations. The second, 
was a group of teachers drawn from each of the 50 states and the District of Columbia, and the 
third was a group of minority teachers provided by the NEA. Each of these groups and their 
rationale for inclusion are provided below. 

Constituencies . Professional and community organizations were included in the survey 
because they represent relevant decision- and policy-makers with respect to teacher education 
and licensure and certification. The 10 constituencies involved in this phase of the study and the 
number of participants from each one is provided in Table 1. Surveys were administered to 630 
state-level representatives across the 10 constituencies. Their names and addresses were 
provided by the director or executive director of each constituency. 

Teachers . Since the purpose of this study is to define the domain of enabling skills 
judged to be important for all entry-level teachers regardless of school level or subject matter 



^ T\vo differtnt demographic sections were used in this study: one for constituent respondents and one for both groups of teacher 
respondent Bc4h versions are included in Appendix D, 
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taught, it seemed appropriate to involve large numbers of practicing teachers in the process used 
to identify these skills. The intent was to obtain judgments from a large national group of 
teachers, that gave each state and the District of Columbia equal weight in the sampling 
procedure. One hundred twenty teachers (40 elementary, 40 middle, and 40 secondary school 
teachers) from each state (and the District of Columbia) were asked to participate in this study. 
The names and addresses of the 6,120 teachers were obtained by random selection from the 
comprehensive lists of teachers in each state maintained by a well established marketing 
research firm. Market Data Retrieval (MDR). MDR claims coverage of over 90% of the public 
school teachers in the United States. 

Minority Teachers . One of the important questions this study sought to answer was 
whether majority and minority teachers agree on the enabling skills judged to be important for 
entry-level teachers. Since MDR could not identify the race/ethnicity of the teachers within its 
database, project staff believed that it would be appropriate to identify a supplementary group of 
minority teachers. This would increase the likelihood that a sufficient number of minority 
teacher responses would be available for separate analyses. The NEA agreed to select a random 
sample of 250 Black and 250 Hispanic teachers from each school level from their membership 
files. In order to maintain the confidentiality of their members, NEA agreed to mail the 1,500 
surveys to their members. 

To distinguish between the two groups of teacher participants, the group of 6,120 
teachers provided by the private survey organization will be referred to as the primary group of 
teachers. The group of 1,500 minority teachers provided by the NEA will be referred to as the 
supplementary group of teachers. 

Table 1 

Number of Survey Participants from Each Constituency 



Conttltiificv 

NcUooal AsMdatkMt of SXMf Directors of T««ctMr Education and Cortiflcatlon (NASDTHC) 

Amorioan Aaaoelatfon of Co<{«g«a for Taaehar Education (AACTE) 

National Aaaodatlon of ElMtontary School PrinclpaU (NAESP) 

National Aaaodatlon of Socondary School Princlpala (NASSP) 

Amarican Aaaoolatlon of School Admlnlttratora (AASA) 

National Paront TaachMr Association (NPTA) 

National Association of Stata Boards of Education (NASBE) 

National School Board Association (NSBA) 

Amarican Fadaratlon of Taachars (AFT) 

National Education Association (NEA) 



N 

50 

74 

50 

48 

48 

110 
50 

100 
50 

50 

Total $30 
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Survey Administration 



Administration of the surveys occurred during the months of May 1989 through January 
1990. Accompanying each survey was a postage-paid return envelope (addressed to ETS) and a 
letter of invitation to participate. The letter briefly explained the purpose of the study and the 
importance of participation. Nine of the 10 constituencies provided a letter on their stationary 
with the signature of either the executive director or president encouraging their members to 
complete the survey and return it to ETS. One of the constituencies was in the process of 
changing presidents and did not believe it was appropriate to have the letter come directly from 
its executive office. They preferred to have the letter come directly from ETS. All surveys to 
the constituent group were mailed by ETS. 

The letter sent to the primary group of 6,120 teachers came from ETS with the signature 
of Gregory A. Anrig, president of ETS. The survey and the letter sent to the supplementary 
group of UOO teachers came directly from the NEA with the signature of the president of the 
association. The letters from the different groups were adaptations of a letter originally 
designed by ETS, and therefore the content of each was hi^y similar. A minor exception to 
this was that the letter sent to the 6,120 teachers also included an offer of a personalized letter 
of acknowledgement of participation for those who returned surveys. Three sample letters of 
invitation, one from each of the three major groups of participants, i.e., constituencies, primary 
teachers, and supplementary minority teachers, are included in Appendix E. One week 
following the administration of the surveys, a follow-up postcard was mailed to the participants 
reminding them to complete and return the surveys. 

Data Analvsis 

The purpose of the data analysis was to identify a core of enabling skills that was judged 
to be important by the constituent groups as well as by both groups of teachers participnting in 
the large-scale surveys. The results of the survey were to be used to develop examination 
specifications that included enabling skills of greater importance and exclude J enabling skills of 
lesser importance. 

Three primary analyses were conducted: (1) frequency distributions of importance 
ratings, (2) means of importance ratings, and (3) correlations of mean importance ratings. Each 
analysis contributes a significant piece of information, that when evaluated in total, provides 
substantial information that can be used to identify a core of important enabling skills for entry- 
level teachers. 

Frequency distributions across the response categories for each enabling skill were 
computed. This analysis makes it possible to identify the percent of respondents who judged 
each enabling skill to be of little importance or of no importance (a scale value of 1 or 2) and 
very important or extremely important (a scale value of 4 or 5). A mean importance value for 
each enabling skill was also computed. Means were computed for the total group of constituent 
respondents and both groups of teacher respondents as well as for relevant subgroups of teacher 
respondents (e.g., elementary, middle, secondary; Black, Hispanic, White). The subgroup 
comparisons are critical for identifying enabling skills that are important for all relevant 
subgroups of entry-level teachers. The mean ratings may then be used to identify the most 
important enabling skills for inclusion in the Stage I assessment measures. In addition, to 
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determine the reliability of the mean importance ratings, two estimates of interrater reliability 
were computed: (1) group split half correlations and (2) intraclass correlations. Lastly, a 
Pearson product-moment correlation of the mean importance ratings for various subgroups of 
teacher respondents was computed. Specifically, the profile of 134 enabling skill means for one 
subgroup (e.g., females) was correlated with the profile of 134 enabling skill means for another 
subgroup (e.g., males). This analysis is used to determine the similarity in the patterns of the 
mean ratings for the subgroups. High correlations are indicative of congruent perceptions with 
respect to the relative importance of the enabling skills (Branch, 1990). 

Eligibilitv Standards . Given the importance of the test that will ultimately be developed 
using the results of this job analysis, ETS project staff thought it would be desirable to set 
standards for use in deciding which enabling skills would be eligible for consideration in 
designing test specifications. While the job analysis literature does not specify what standards 
should be set, or even whether they need to be set, ETS project staff believed that, at the very 
least, a majority of the respondents should judge a skill as being at least moderately important 
for it to be considered eligible for consideration in the examination specifications. Therefore, 
the following two standards were established: (1) fewer than 20% of the respondents judged an 
enabling skill to be of little importance (scale value of 2) or of no importance (scale value of 1), 
and (2) its mean importance value was at least 3.50 (the midpoint between moderately 
important and very important). It is believed that these criteria (consistent with the intent of 
content validity) substantially decrease the probability of including any unimportant enabling 
skills in the Stage I assessment measures. ETS believes that these standards may be considered 
to be conservative, and that content not meeting these standards could reasonably be considered 
for examination specifications in a licensing context. (It should be noted that these standards 
serve primarily as minimum levels and that the Test Development Committee is strongly 
encouraged to select for inclusion those enabling skills with the highest mean ratings, i.e., to go 
as far above the 3.50 standard as possible, while still maintaining sufficient breadth of content 
coverage.) 

Interpretation of Mean Analysis and Eligibility Standard . The objective of this study is 
to identify a subset of enabling skills that is important for all entry-level teachers. This places 
emphasis on the analysis of means by relevant subgroups of teachers and the total group of 
constituents. The determining factor is whether or not an enabling skill at le^ st meets the mean 
eligibility standard of 3.50 for each of the relevant subgroups of teacher respondents and for the 
total group of constituent respondents. An enabling skill that receiver a mean rating of less than 
3^0 by any relevant subgroup of teachers or the constituent respondents is not considered 
eligible for inclusion in the Stage I assessments. An enabling skill that receives a mean rating of 
3.50 or greater by all the relevant subgroups of teachers and the constituent respondents is 
considered eligible for inclusion. Therefore, for the purpose of this study, it is not necessary to 
evaluate level differences by subgroup for enabling skills within the "exclusion" and "Liclusion" 
clusters. 

Results 

The results fiirst will be presented for each of the three respondent groups separately; 
this will be followed by a comparison across the respondent groups. 
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Section 1: Constituent Respondents 



The constituencies that were selected represent a wide range of decision-makers with 
respect to teacher licensure and certification. Since the intent was not to focus upon the 
responses of any one constituency, but on the collective responses of this group of decision- 
makers, the results of the survey administration are presented in aggregate. 

Description of Survey Respondents . Of the 630 surveys, 289 were returned (46% 
response rate). Eleven percent of the respondents were from NASDTEC; 16% were from 
AACTE; and 14% were from NPTA. Twenty-six percent were from the three administrator 
associations: NAESP, NASSP, and AASA. Twenty percent were from the two school board 
associations: NASBE and NSBA; and 14% were from the two teacher unions: AFT and NEA 
Fifty-eight percent of the respondents were male and 42% were female. Eighty percent were 
over the age of 43 years; and 90% of the respondents were White. 

Frequency Distributions Across Response Categories. For each of the 134 enabling skills 
the percent of respondents who judged it to be of little importance or of no importance and very 
important or extremely important was computed (see Appendix F). Only one enabling skill was 
judged to be of little importance or of no importance by more than 20% of the respondents: 
#75 (use examples from the history of mathematics). This skill was judged to be of little 
importance or of no importance by 98 (34%) respondents. Therefore, according to the 20% 
standard, 133 enabling skills (99% of the content domain) may be considered to be eligible for 
inclusion as part of the Stage I assessment measures. In addition, it is worth noting that 98% of 
the enabling skills wc*e judged to be very important or extremely important by 50% or more of 
the respondents. 

Mean Ratings of Enabling Skill Importance . The mean importance value for each 
enabling skill was computed to identify the most important skiUs from within the larger content 
domain (see Appendix F). Approximately 80% (n=« 107) of the enabling skills had a mean 
importance rating of 4.00 (ver>" important) or higher. Th<^ mean ratings ranged from a low of 
2.90 for enabling skill #75 (use examples from the history of mathematics) to a high of 4.85 for 
#1 (determine main ideas). Only two enabling skills received a mean rating of less than 3.50 
(the midpoint between moderately and very important). These skills were within the dimension 
of Mathematics: #63 (recognize relationships of variables, M=3.47) and #75 (M*2.90). 
Enabling skill #75 was also "flagged" by the frequency analysis. Since these two skills did not 
meet the 3.50 standard, they are not eligible for inclusion in the assessment measures (unless 
the Test Development Committee provides strong rationale to the contrary). More than 98% of 
the content domain (n»132) is eligible for consideration in the development of examination 
^ecifications based on the results obtained from this group of respondents. These findings 
provide substantial confirmation of the judgment of the Advisory Committee me.nbers who were 
asked to identify a domain of enabling skills important for all entry-level teachers. 

Reliabilitv of Importance Ratings . In order to determine the reliability of the 
importance ratings provided by the group of constituent respondents, two interrater reliability 
measures were computed: (1) group split half correlations (Cornelius, 1988^ and (2) intraclass 
correlations (Lahey, Downey, & Saal, 1983). In the group split half measure, the total group of 
constituent respondents was randomly divided into two halves, and the mean importance rating 
for each of the 134 enabling skills was computed. The profile of 134 enabling skill means for 
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one half then was correlated with the profile of 134 enabling skill means for the other half. 
* The split half reliability estimate was .98. The intraclass correlation was computed using analysis 
of variance procedures that treated respondents as a random effect (see Shrout & Fleiss, 1979; 
Formulas ICC(24) and ICC (2,K)). Treatment of the respondents as a random effect, permits 
the generalization of the results to other groups of similarly selected constituent respondents. 
The intraclass correlation reliability estimate also was .98. The magnitude of these estimates 
indicates that the importance ratings provided by the constituent respondents are highly reliable. 
This indicates that highly similar distributions of ratings would likely be obtained if the survey 
were administered to other groups drawn from the same constituencies in the same manner. 

Summary of Results for Constituent Respondents 

The results of the frequency analysis indicated that one enabling skill within the 
dimension of Mathematics was judged to be of little importance or of no importance by more 
than 20% of the respondents. Thirty-four percent of the respondents judged enabling skill #75 
(use examples from the history of mathematics) to be of little or no importance. The mean 
analysis revealed two enabling skills, both within the dimension of Mathematics, that had a 
mean importance rating of less than 3.50: #63 (recognize relationships among variables) and 
#75. More than 98% of the enabling skills content domain met or exceeded the eligibility 
standards set for consideration in the development of examination specifications. The results of 
the reliability analyses indicated that the mean importance ratings were highly reliable; such that 
similar distributions of mean importance ratings would very likely be provided by another group 
drawn from the same constituencies in the sam 5 manner. These results verify the judgments of 
the committees of subject-matter experts who were asked to construct a domain of important 
enabling skills. 

Section 2: Teacher Respondents : Primary Group 

The results for the primary group of teacher respondents first will be presented at the 
aggregate level. Then the results will be presented for relevant subgroups of teachers. Enabling 
skills that are judged to be important (a mean rating of 3.50 or higher) by all the relevant 
subgroups of teachers will be considered to be part of the core of important enabling skills. 

Total Group of Respondents 

Description of Survey Respondents . Of the 6,120 surveys, 2,269 were returned (37% 
response rate). Twenty-eight percent of the respondents were from an urban school setting; 
35% were from a suburban setting; and 37% were from a rural setting. Seventy-three percent 
were between the ages of 35 and 54 years. Seventy-eight percent had 11 or more years of 
teaching experience. Sixty-five percent were female and 35% were male. Ninety percent were 
White (non-Hispanic); 6% were Black; and 2% were Hispanic. Thirty percent of the 
respondents were elementary school teachers; 30% were middle school teachers; and 41% were 
secondary school teachers. The number of respondents, by state, ranged from a low of 29 from 
California to a high of 62 from Indiana. These demographic distributions are highly similar to 
those reported in a national study conducted by the National Center for Education Information 
(NCEI) (Feistritzer, 1986). A comparison of these distributions for variables common to both 
studies is presented in Table 2. The high degree of similarity may be used as an indicator of the 
representativeness of the primary group of teachers who participated in the present study. A 
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complete description of the demographic characteristics of the primary group of teacher 
respondents is provided in Appendix G. 

Frequency Distributions Across Response Categories . The percent of respondents who 
judged each enabling skill to be of little importance or of no importance and very important or 
extremely important is presented in Appendix H. Of the 134 enabling skills, 3 were judged to be 
of little importance or of no importance by more than 20% of the respondents. These three 
skills were within the dimension of Mathematics: #61 (interpret range, variance, standard 
deviation, 21%); #63 (recognize relationships among variables, 25%); and #75 (use examples 
from the history of mathematics, 42%). The other 131 enabling skills (98% of the content 
domain) met the frequency standard to be considered eligible for inclusion in the Stage I 
assessments. In addition, 94% of the enabling skills were judged to be either very important or 
extremely important by 50% or more of the respondents. 

Tabi« 2 

Comparison of Demographic Distributions: Primary Teacher Respondents and 
fiSSL 



Dtnoqfphte Chfcfristlc Twrfw WCEI ^ 

Sex 

35 31 
65 69 



RaM/Ettmidty 

90 91 

Btook 6 6 

Htopanic 2 2 
Age(yMrs) 

< 25 1 2 
25-34 15 23 
35-44 43 41 
45-54 31 23 
55 > 11 11 

Exp«r<«noe (yMr«) 

< 5 • 6 

e-10 14 16 

11-15 21 24 

16 - 20 24 22 

21 > M 30 

Mean Ratings of Enabling Skill Importance . The mean importance rating and standard 
deviation for each of the 134 enabling skills is presented in Appendix H. Sixty-six percent of the 
enabling skills had a mean importance rating of 4.00 (very important) or higher. The means 
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ranged from a low of 2.27 for enabling #75 (use examples from the history of mathematics) to a 
high of 4.77 for #1 (determine main ideas). Six enabling skills received a mean importance 
rating of less than 3.50. One skill was within the dimension of Reading: #14 (recognize style, 
M « 3.37). Four skills were within the dimension of Mathematics: #61 (interpret range, 
variance, standard deviation, M « 3.22); #63 (recognize relationships among variables, 
M » 3.20); #66 (recognize patterns, M ^ 3.36); and #75. One skiU was within the dimension 
of Listening: #100 (understand spoken English dialects, M = 3.47). Enabling skills #61, #63, 
and #75 were also "flagged" by the frequency analysis. The failure of these six enabling skills to 
meet the 3.50 standard excludes them from the Stage I assessment measures (contingent upon 
the recommendations of the Test Development Committee). More than 95% of the content 
domain (n«128) met or exceeded the mean rating standard of 3.50 and is eligible for 
consideration in the development of examination specifications based on the results obtained 
from this group of respondents. These findings verify the judgments of the Advisory Committee 
members. The large-scale survey of teachers confmns that the vast majority of enabling skills 
identified as being important for entry-level teachers by the Committee was also judged 
important by a large number of practicing teachers from across the country. 

Reliability of Importance Ratings . Group split half and intraclass correlations were 
computed to determine the reliability of the importance ratings provided by the primary group 
of teacher respondents. The group split half reliability estimate was .99; and the intraclass 
correlation reliability also was .99, indicating an extremely high level of reliability. This indicates 
that another group of teachers selected in a similar manner would very likely provide ratings 
that were highly related to those obtained from this group of teachers. 

Content Analysis of Respondents^ Write-in Comments . As described previously, the job 
analysis survey included a section that provided respondents with an opportunity to list any 
additional dimensions and enabling skills that they believed should be included in the domain. 
A random sample of approximately 300 surveys were content analyzed. The most consistent 
trend was the mention of personal qualities associated with teaching, e.g,, dedication, motivation. 
While these may very well be important facets of teacher competency, it was decided from the 
outset that such factors would not be addressed in the Stage I assessment. 

Responses bv Relevant Subgroups 

While the analyses at the total group level are useful, the critical issue is whether or not 
an enabling skill meets or exceeds the 3.50 eligibility standard for all relevant subgroups of 
teachers. Therefore, separate analyses were conducted to determine how relevant subgroups of 
teachers judged the enabling skills. Since preliminary findings indicated that the mean analysis 
was a more conservative measure than the frequency analysis (i.e., identified for possible 
exclusion a greater number of enabling skills), response frequencies were not computed at the 
subgroup level. 

Responses hv Race /Ethnicity 

Mean Ratings of Enabling Skill Importance . Mean importance ratings were computed 
for Black, White, and Hispanic respondents. (Insufficient number of respondents precluded the 
inclusion of other races/ethnicities in the analysis). The mean importance ratings for these 
three subgroups are presented in Appendix 1. The means for the Black respondents ranged 
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from a low of 3.19 for skill #75 (use examples from the history of mathematics) to a hi^ of 
4.75 for skill #56 (perform computations). The means for the White respondents ranged from a 
low of 2*67 for skill #75 to a high of 4.78 for skill #1 (determine main idea). The means for 
Hispanic respondents ranged from a low of 3.12 for skill #75 to a high of 4.79 for skills #19 
(use table of contents) and #44 (recognize basic grammatical errors). Seven enabling skills 
received mean importance ratings of less than 3.50 by one or more of the three subgroups. 
These seven skills and their means are presented in Table 3, The exclusion of these seven 
enabling skills still leaves 95% of the content domain (n= 127) eligible for inclusion in the 
assessment measures. 

Tabl« 3 

Mean Importance Ratings by Race/Ethnicity for the Seven EnabUny Skills That DM Not Meet the 
3,50 Standard > Primary Teacher Respondents 



BLACK 



WHrrE 



HISPANIC 



HEADIHQ 

14. n tcognixt «tyl« 
MATHEMATICS 

•1. Inttrprvt range, variance, S.D. 

93. Raoognlza raMonahlpa among variablaa 

65. WHia aquatlona uaing variablaa 

66. Raoognlza pattacna 

75. Uaa axamplaa from hiatory of mathamatica 
USTENING 

100. Undaratand apokaw Engllah dialacta 



3.47 
3.46 



X19 



3.35 

3.19 
3.17 
3.46 

3.33 
2.67 

3.43 



3.46 

3.44 
3.46 

3.12 



Agreement in Relative Importance Among Races/Ethnicities . In order to determine the 
extent of agreement among the subgroups as to the relative importance of the enabling skills, 
Pearson product-moment correlations were computed. The profile of 134 mean importance 
ratings for each subgroup was correlated. These values are presented in Table 4. All the values 
exceeded .90, indicating a very high level of agreement among the subgroups. 



Tabl6 4 



^Uitlon Matrix q1 Mean Ratings of Enabling Skill Importance 



Black 



Whita 



HIapanIc 



EUack 



.93 



.91 



Htapanic 
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Responses bv Sex 



Mean Ratings of Enabling Skill Importance . Mean importance ratings were computed 
for female and male respondents. The mean importance ratings and standard deviations arc 
presented in Appendix J. The means for females ranged from a low of 2.73 for skill #75 (use 
examples from the history of mathematics) to a high of 4.80 for skill #1 (determine main idea). 
The means for males ranged from a low of 2.69 for skill #75 to a high of 4.72 for skill #1. Nine 
enabling skills received mean importance ratings of less than 3.50 by at least one of the two 
subgroups. These nine skills and their means are presented in Table 5. The exclusion of these 
nine enabling skills leaves 93% of the content domain (n=125) eligible for inclusion in the 
assessment measures. 

Table 5 

Mean Importance Ratings by Sex for the Nine Enabling Skills That Did Not Meet the 3.50 
Standard Primary Teacher Respondents 



FEMALE 


MALE 


READING 






14. RMognlM ttyto 


3.47 


3.18 


MATHEMATICS 






60. Infrprt mmmn, median, mock 




3.49 


$1. Infrprt r«ng«, vMi«nc«, S.D. 


3.27 


3.13 


S3. R«ooQn<z« r«<ationthlps among varUibias 


3.15 


3J27 


66. Raoogniz* pattama 


3.38 


3.30 


74. Damenstrata fundamantal algorfthma 




3.47 


75* Uaa axamplaa from hiatory of mathamattca 


Z73 


Z69 


7S. Uaa a varlaty of malariala 




3.48 


USTENING 






100. Undaratand apokan Engllah dialada 




3^ 



Agreement in Relative Importance Between Sexes . In order to determine the extent of 
agreement between females and males as to the relative importance of the enabling skills, 
Pearson product-moment correlations were computed. The profile of 134 mean importance 
ratings for the two subgroups was correlated. The obtained correlation was .97, indicating a very 
high level of agreement in their distributions of mean importance ratings. 

Responses bv Teaching Experience 

Mean Ratings of Enabling Skill Importance . Mean importance ratings were computed 
for respondents with 5 or less years of teaching experience, 6 to 10 years, 11 to 15 years, 16 to 
20 years, and 21 or more years. The mean importance ratings and standard deviations are 
presented in Appendix KL The means for respondents with 5 or less years of teaching 
experience ranged from a low of 2.75 for skill # 75 (use examples from the history of 
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mathematics) to a high of 4.76 for skill #111 (recognize when a message has not been 
understood). The means for respondents with 6 to 10 years of experience ranged from a low of 
'2J1 for skill #75 to a high of 4.79 for skill #1 (determine main idea). The means for 
respondents with 11 to 15 years of experience ranged from a low of 2.64 for skill #75 to a high 
of 4.76 for skill #1. The means for respondents with 16 to 20 years of experience ranged from a 
low of 2.69 for skill #75 to a high of 4.80 for skill #1. The means for respondents with 21 or 
more years of experience ranged from a low of 2.78 for skill #75 to a high of 4.76 for skill #1. 
Seven enabling skills received mean importance ratings of less than 3.50 by one or more of these 
respondent subgroups. These seven skills and their means are presented in Table 6. The 
exclusion of these seven enabling skills leaves 95% of the content domain (n= 127) eligible for 
inclusion in the assessment measures. 



Table 6 

Maan Importance Ratings bv Teachtnq Experience for the Seven Enabling Skills That Did Not MwX 
the 3.S0 Standard > Prima ry Teacher Respondents 



^ 5 yf 



S-10yr» 



15-20 vf I & 21 yf% 



14. RttoogniM styl« 3.46 3.31 3.39 

61. Inl0fpr«t rang*, variance, S.D. 3.38 3.12 3.22 

63. Raeoenlza ralationiOiips among variabias 3.30 3.15 3.11 

65. Wrila aqtiationa using variaMaa 

66. Raoognlxa pattama 3.46 3.36 3.29 
75. Uaa axampiaa from history of math 2.75 2.71 2.64 

100. UndaraUnd spokan EngHsh diaiacta 



3.39 

3.21 
3.21 

3.36 
2.69 

3.38 



3.34 

3.22 
3.23 
3.44 
3.36 
2.78 

3.44 



Agreement in Relative Importance Among Lev els of Teaching Experience. The profiles 
of 134 mean importance ratings for each subgroup were correlated. These values are presented 
in Table 7. All values exceeded .95, indicating that the distributions of mean ratings among the 
different levels of teaching experience are highly similar. 

Table 7 

Intercorrelatlon Matrix of Mean Ratings of Enablino Skill Importance 



2! Syrs 



6 • 10 yrt 



11 • 15yr» 



16-20yni 



& 21 yrt 



s Syrs 
6-10yrs 
11 -ISyrt 
16-20yr« 
2 21 yrt 



.96 



.96 

.99 



.97 
.99 
.99 



.97 
.96 
.99 
.99 
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Responses hv Subject Taught 



Mean Ratings of Enabling Skill Importance . Means were computed by those subjects 
that had sufficient numbers of respondents. Mean importance ratmgs were computed for 
respondents who taught business and vocational education (B & V Ed.), social sciences (Soc. 
Sci.), physical and biological sciences (P & B Sci.), mathematics and computer science (M & C 
ScL), language arts (Lan. Arts), and special education (Special Ed.). The mean ratings and 
standard deviations for these subgroups are presented in Appendix L. The means for 
respondents who taught business and vocational education ranged from a low of 2.61 for 
enabling skill #75 (use examples from the history of mathematics) to a high of 4.74 for skill #19 
(use table of contents). The means for respondents who taught social sciences ranged from a 
low of 2.79 for skill #75 to a high of 4.80 for skill #1 (determine main idea). The means for 
respondents who taught physical and biological sciences ranged from a low of 2.81 for skill #75 
to a high of 4.78 for skill #1. The means for respondents who taught mathematics and 
computer science ranged from a low of 2.65 for skill #75 to a high of 4.70 for skill #1. The 
means for respondents who taught language arts ranged from a Iojk 6f 2.67 for skill #75 to a 
high of 4.84 for skill #1. The means for respondents who taught 'sp«:ial education ranged from 
a low of 2.64 for skill #75 to a high of 4.79 for skill #1. Twenty-one enabling skills received 
mean importance ratings of less than 3.50 by one or more of the subgroups. These 21 skills and 
their mer.ns are presented in Table 8 (see page 18). The exclusion of these 21 enabling skills 
leaves 84% of the content domain (n = 113) eligible for inclusion in the Stage I assessments. 

Agreement in Relative Importance Among Subjects Taught . The correlations among the 
profiles of 134 means across the different subjects taught are presented in Table 9. All the 
correlations either met or exceed a value of .85. This indicates that the distribution of means 
across the different subjects taught are highly similar. 

Table 9 - 



Intercorrelation Matrix of Mean Ratings of Enabling Skill Importance 





BaVEci 


Soc ScL 


PABSd. 


MaCScL 


Uin. Arts 


SpM^iat Ed. 


aavEd. 


.93 


.94 


.94 


.92 


.94 


SocSei. 




.90 


.85 


M 


.92 


paasoL 






.97 


M 


.90 


MaCSd. 








M 


.90 



Un,Art» .94 
Special Ed. 

Responses bv School Setting 

Mean Ratings of Enabling Skill Importance . Mean importance ratings were computed 
for respondents from urban, suburban, and rural school settings. The means and standard 
deviations for these subgroups are presented in Appendix M. The means for respondents from 
an urban school setting ranged from a low of 2.83 for skill #75 (use example from the history of 
mathematics) to a high of 4.76 for skUl #1 (determine main idea). The means for respondents 
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from a suburban school setting ranged from a low of 2.60 for skill #75 to a high of 4.80 for slall 
#1 The means for respondents from a rural school setting ranged from a low of 2.73 for skiU 
#75 to a high of 4 65 for skill #56 (perform computations). Nine enabling skills received mean 
importance ratings of less than 3.50 by one or more of the subgroups. These nine skills and 
their means are presented in Table 10 (see page 19). The exclusion of these nine skills leaves 
93% of the content domain (n = 125) eUgible for inclusion in the assessment measures. 

4 

Tabto 10 

MMn ImDOftonce Ratings bv ^fihool Settin g tor the Nine Enabling Skills That Diet Npt Mggt thg 
Standnrri > Primary Teacher Respondents 



URBAN 



SUBURBAN 



RURAL 



14. RseognUe «tyl« 

60. MMpfM mMn, median, mod* 

ei . MmptM rang«, variance, S.O. 

63. R«oogntze rstatlonshlps among variaMaa 

65. ..ifHa aquatfona uaing variablaa 

66. Raoogniza pattama 

67. Uaa formulaa for datarminlng langth 

75. Uaa axamplaa from hiatofy of mathamatloa 

100. Undaratawi apokan Engllah dialacta 



3.42 

3.28 
3.23 

3.38 

Z83 



3.37 



3.19 
3.16 

3.37 
3.48 
2.60 

X40 



3.31 

3.49 
3.19 
3.20 
X48 
3.32 

2.73 

X44 



Agreement in Relative Importance Am ong School Settings. The profile of 134 mean 
importance ratings for each subgroup was correlated. These values are presented in Table 11. 
All the values were .99, indicating that the distributions of ratings among the respondents from 
the different school settings are extremely similar. 

Tabte 11 

Intercorrelation Matrix of Mean Ratings of Enabling Skill Imoortancg 



Urban 



Subtiftoan 



Rural 



UrtMMi 

S ubM f toa n 

Rural 



.99 
.99 



Responses hv School Level 

Mean Rating of Enabling Skill Importance . Mean importance ratings were computed 
for respondents from elementary, middle, and secondary school levels. The means and standard 

19 



ERLC 



3() 



deviations are presented in Appendix N. The means for respondents from elementary schools 
ranged from a low of 2.80 for skill #75 (use examples from the history of mathematics) to a 
high of 4.78 for skill #44 (recognize basic grammatical errors). The means for respondents from 
middle schools ranged from a low of 2.76 for skill #75 to a high of 4.69 for skill #104 (speak 
loudly enough to be heard). The means for respondents from secondary schools ranged from a 
low of 2.63 for skill #75 to a high of 4.66 for skill #104. Ten enabling skills received mean 
importance ratings of less than 3.50. These 10 skills and their means are presented in Table 12. 
The exclusion of these 10 enabling skills leaves 93% of the content domain (n= 124) eligible for 
inclusion in the assessment measures. 

Table 12 

Mean Importance Ratings bv School Le vel for the 10 Enabling SkHls That Did Not Meet the 3,50 
Standard ■> Piimary Taa cher Respondents 



ELEMENTARY 



MIDDLE 



SECONDARY 



BEABMfi 

14. R«oognlz« ttyi« 

61 . Intsrprtt rang^, varianct, S.D. 

63, RaoogniM raUillonshlpa among variabtas 

69. WHIa aqtiatiofia uaing variablaa 

66. Raoognlza patterns 

67. Uaa fofimilaa for datarmlning hmglh 
74. Damon a tr a la fundamantal algodthms 

79. Uaa a Ma m p la i from hiatory of mathamatSca 
76. Uaa a varlaty of materlala 
USTEWPiG 

100. Undaratand apokan English diaiacta 



3J26 
3.10 



2.80 



3.39 

3.22 
3.21 

3.31 
2.76 



3.29 

3.19 
3.26 
3.42 
3.27 
3.41 
3.42 
2.63 
3.36 

3.39 



Agreement in Relative Tmportance A mong School Levels . The profile of 134 mean 
importance ratings for each subgroup was correlated. These values are presented in Table 13. 
All the values exceeded .90, indicating that the distributions of mean ratings of the respondents 
from the different school levels are highly similar. 



Table 13 



InterconrelaHon Matrix of Mean Ratings of Enabling Skill Importenca 



Elfn»nfrv 



Mtddto 



Secondary 



El«fiMntary 
Middle 



.97 



.92 
.99 



20 



37 



Responses by Geographic Region 



Mean Ratings of Enabling Skill Importance . Mean importance ratings were computed 
for respondents from four geographic regions: Far West, Southern, central, and Northeast. 
These regional breakdowns are consistent with those recommended by the National Association 
of State Directors of Teacher Education and Certification (NASDTEC). A list of the states 
within each of the four regions is presented in Appendix O. The means and standard deviations 
for these regions are presented in Appendix P. The means for the far west region ranged from 
a low of 2.67 for skill #75 (use examples from the history of mathematics) to a high of 4.74 for 
skill #1 (determine main idea). The means for the southern region ranged from a low of 2.90 
for skill #75 to a high of 4.81 for skill #44 (recognize basic grammatical errors). The means for 
the central region ranged from a low of 2.63 for skill #75 to a high of 4.75 for skill #1. The 
means for the northeast region ranged from a low of 2.70 for skill #75 to a high of 4.82 for skill 
#1. Nine enabling skills received mean importance ratings of less than 3.50 by one or more of 
the regional subgroups. These nine skills and their means are presented in Table 14. The 
exclusion of these nine skills leaves 93% of the content domain ( n= 125) eligible for inclusion in 
the assessment measures. 

Tabi0 14 

Mean Importance Ratings by Geographic Region for the Nine Enablina Skills That Did Not Meet 
the 3.S0 Standard > Primary Teacher Respondents 
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FAR WEST 


SOUTHERN 


CENTRAL 


NORTHEAST 


READWQ 










14. R«oo9n(z« styto 


3.26 


3.46 


3.27 




MATTCMAT1CS 










60. IfiHf prt iuMwi, m«dlafif mod« 


X49 








61. httf prt rang#, variant, S.D. 


3.10 


3.36 


3.16 


3.26 


63. R60ognlM relationships among variabias 


X13 




3.12 


3.22 


66. VfrUa aquations using variaMaa 


3.46 




3.42 




66. Raoognlza pattams 


3.31 


3.45 


3.26 


X36 


67. Usa fonmilas for datarmlnlng tangth 


3.46 




3.46 




75. Usa axamplaa from history of math 


2.67 


2.90 


2.63 


2.70 












100. Undarstand spokan English diataots 


X3S 


3.64 


3.38 





Agreement in Relative Importance Among Regions . The correlations among the- profile 
of 134 means for the regions are presented in Table 15. All values exceeded .95, indicating that 
the distributions of mean ratings among the different geographic regions are highly similar. 
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Table 15 

intefcorretotton Matrix of Mean Ratlnaa of Enablino Skill Importance 



FarW—t 



Southern 



Cfitral 



North— t 



.98 



.99 



.98 



Southern 



.99 



.98 



Central 



.98 



Woflfteett 



Summaiv of Results for the Primary Group of Teacher Respondents 

The results of the frequency analysis indicated that three enabling skills all within the 
dimension of Mathematics were judged to be of little importance or of no importance by more 
than 20% of the respondents. Twenty-one percent judged enabling skill #61 (interpret range, 
variance, and standard deviation) to be of little or no importance; 25% made the same judgment 
for #63 (recognize relationships among variables); and 42% made the same judgment for #75 
(use examples from the history of math). The mean analyses across the relevant subgroups 
revealed a total of 21 enabling skills that had a mean importance rating of less than 3.50. These 
enabling skills and their mean values are presented in Table 16. With the exclusion of these 21 
enabling skills, 84% of the enabling skills content domain still is eligible for inclusion in the 
development of examination specifications. Finally, like the results for the constituent 
respondents, the mean importance ratings for primary group of teacher respondents were highly 
reliable. The subgroup analyses indicated that the importance ratings were very similar 
regardless of race/ethnicity, sex, subject taught, school setting, school level, and geographic 
region. The subgroup analysis also revealed that many of the enabling skills that did not meet 
the 3.50 standard were attributable to the subject tau^t by the respondents. In particular, 
business and vocational education accounted for most of the enabling skills judged to be less 
than 3.50. In addition, more than 80% of the enabling skills met or exceeded the mean rating 
standard of 3.50 within each of the relevant subgroups. 

Section 3: Teacher Respondents: Supplementa ry Group 

The results for the supplementary group of teacher respondents first will be presented at 
the aggregate level. Then the results of the mean analysis will be presented for the Black and 
Hispanic respondents. Finally, the extent of agreement in the relative importance of the 
enabling skills ratings between these subgroups will be presented. 

Total Group of Respondents 

Description of Survey Respondents . Of the 1,500 surveys, 312 (21% response rate) were 
returned. Thirty-nine percent of the respondents were Black; 40% were Hispanic; and 39% 
were White non-Hispanic (the percentage for race/ethnicity was greater than 100 due to 
multiple responses). Thirty-six percent were from an urban school setting; 32% were from a 
suburban setting; and 32% were from a rural setting. Sixty-five percent were between the ages 
of 35 and 54 years. Seventy-one percent had 11 or more years of teaching experience. Seventy- 
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seven percent were female and 24% were male. Thirty-eight percent of the respondents were 
elementary school teachers; 27% were middle school teachers; and 33% were secondary school 
teachers. 

Since the intent of including the supplementary group of teacher respondents was to 
augment minority representation, those respondents who described themselves as White non- 
Hispanic were excluded. After correcting for this, the total number of minority (i.e.. Black and 
Hi^anic) respondents was 236. Of this 236, 48% (n» 114) were Black, and 52% (n= 122) were 
Hispanic The responses from the 236 minority teachers were used in all subsequent analyses. 

Frequency Distributions Across Response Categories . The percent of respondents who 
judged each enabling skill to be of little importance or of no importance and very important or 
extremely important is presented in Appendix M. Of the 134 enabling skills, 2 were judged to 
be of little importance or of no importance by more than 20% of the respondents. These two 
skills were within the dimension of Mathematics: #63 (recognize relationships among variables, 
21%) and #75 (use examples from the history of mathematics, 36%). The other 132 enabling 
skills (99% of the content domain) may be considered to be eligible for inclusion in the Stage I 
assessments. In addition, 99% of the enabling skills were judged to be either very important or 
«tremely important by 50% or more of the respondents. 

Mean Ratings of Enabling Skill Importance . The mean importance rating for each of 
the 134 enabling skills is presented in Appendix M. Sixty-four percent of the enabling skills had 
a mean rating of 4.00 or higher. The means ranged from a low of 2.91 for enabling skill #75 
(use examples from the history of mathematics) to a high of 4.70 for enabling skill #19 (use 
table of contents). Four enabling skills received mean importance ratings of less than 3.50. All 
four were within the dimension of Mathematics: #61 (interpret range, variance, standard 
deviation, M«339); #63 (recognize relationships among variables, M=3.28); #66 (recognize 
patterns, M*3.49); and #75 (use examples from the history of mathematics, M*2.91). The 
exclusion of these four enabling skills leaves 97% of the content domain (n« 130) eligible for 
inclusion in the assessment measures. 

Reliability of Importance Ratings . Group split half and intraclass correlations were 
computed to determine the reliability of the importance ratings provided by the supplementary 
group of teacher respondents. The group split half reliability estimate was .98; and the 
intraclass correlation reliability was .97, indicating an extremely high level of reliability. 

Responses bv Race/Ethnicitv 

Mean Ratings of Enabling Skill Importance . Mean importance ratings were computed 
for Black and Hispanic respondents. The mean importance ratings and standard deviations are 
presented in Appendix N. The means for Black respondents ranged from a lew of 3.02 for skill 
#75 (use examples from the history of mathematics) to a high of 4.74 for skill #19 (use table of 
contents). The means for Hispanic respondents ranged from a low of 2.82 for skill #75 to a 
high of 4.68 for skill #44 (recognize basic grammatical errors). Seven enabling skills received 
mean importance ratings of less than 3.50 by at least one of the two subgroups. These seven 
skills and their means are presented in Table 17. The exclusion of these seven enabling skills 
leaves 95% of the content domain (n= 127) eligible for inclusion in the assessment measures. 
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Tabte 17 

Mean Importanoe Ratings bv Race/Ethntcttv for the Seven Enabling Skills That Did Not Meet the 
3.50 Standard - Suppienientarv Teacher Respondents 



BLACK 



HISPANIC 



HATOEMATICS 

•1. I n lifp r t v«rt«no«, S.D. 3.37 3.41 

63. R^ooQniM r«tatlOfish!pa among v«ri«M«t 3.26 3.29 

66. Rooognlztt patttmt 3.45 

66* Um various syctomt of moaturamont 3.47 

70. Intarprat logioal connactiv— 3.46 

74. Draw oocract cooduaiona 3.49 

75. Uaa axamplaa frcnn hiatory of mathatnatica X02 2.82 

Agreement in Relative Importance Between Races/Ethnicities . In order to determine 
the extent of agreement between Black and Hispanic respondents as to the relative importance 
of the enabling skills, Pearson product-moment correlations were computed. The profile of 134 
mean importance ratings for each subgroup was correlated. The obtained correlation was .96, 
indicating a very high level of agreement. 



Summary of Results for the Supplementary Group of Teacher Respondents 

The results of the frequency analysis indicated that two enabling skills within the 
dimension of Mathematics were judged to be of little importance or of no importance by more 
than 20% of the respondents. Twenty-one percent of the respondents judged enabling skill #63 
(recognize relationships among variables) to be of little or no importance; and 36% made the 
same judgment for skill #75 (use examples from the history of mathematics). The mean 
analysis revealed seven enabling skills that had a mean importance rating of less than 3.50. All 
seven skills were within the dimension of Mathematics: #61 (interpret range, variance, and 
standard deviation); #63; #66 (recognize patterns); #68 (use various systems of measurement); 
#70 (interpret logical connectives); #72 (draw correct conclusions); and #75. The mean values 
for these seven enabling skills are presented in Table 17. With the exclusion of these seven 
enabling skills, 95% of the enabling skills content domain still is eligible for inclusion in the 
development of examination specifications. In addition, the ianalyses of interrater reliability 
indicated that the importance ratings provided by the supplementary group of teacher 
respondents were highly reliable. 

Summary of Results: Constituent. Primary Teacher, and Supplementan/ Teacher Respondents 

The first three sections of this report presented the results of the frequency and mean 
analyses for each of the respondent groups respectively. In each instance, the mean analysis 
proved to be a more conservative measure than the frequency analysis: it resulted in the 
exclusion of a greater number of enabling skills. 

The interrater reliability of the mean importance ratings for each of the three 
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respondent groups was estimated using group split lialf correlations and intraclass correlations. 
Both measures yielded extremely high reliability estimates (greater than .90) for each of the 
respondent groups. This indicates that highly similar distributions of mean importance ratings 
would be obtained from other groups of constituent, primary and supplementary teacher 
respondents who had been selected and surveyed in a similar manner. 

In addition, the extent of agreement among the relevant subgroups of teachers (within 
both primary and supplementary groups) in terms of the relative importance of the enabling 
skills was measured. This was accomplished by correlating the profiles of the 134 means for the 
different subgroups (e.g., females vs. males). Only two correlations below .90 were obtained. 
Both were .85 and were obtained in the comparison of mean importance ratings by subject 
taught. 

Section 4: Comparisons Across Constituent Primary, and Supplementary Teacher Respondents 

Mean Ratings of Enabling Skill Importance. Across all respondent groups (and relevant 
subgroups), only 21 of the 134 enabling skills (approximately 16% of the content domain) 
received mean importance ratings of less than 3 JO. These 21 enabling skills and their mean 
ratings are presented in Table 18 (see page 27). Unless the Test Development Committee 
provides strong rationale to the contrary, these enabling skills should not be included in the 
Stage I assessment measures. The results of this study clearly demonstrate that 84% of the 
enabling skills content domain was judged to be important by large numbers of teachers, and 
other professional and school-related community groups. These results may be used to support 
the development of a single examination that is appropriate for all teaching candidates 
regardless of sex, race/ethnicity, school level, subject taught, and geographic location. 

Agreement In Relative Importance Among Respondents . Similar to the subgroup 
analyses, the profiles of 134 means for each of the three respondent groups were correlated. 
The obtained values are presented in Table 19. As illustrated, all the values exceeded .90, 
indicating a very high level of agreement among the respondent groups. In addition, 
correlations of the mean profiles for the Black and Hispanic teachers from the primary and 
supplementary groups were computed to determine the extent to which both sets of minority 
teachers agreed in their ratings of relative importance. These values are presented in Table 20 
(see page 28). As illustrated, all the correlations were in the .90s, indicating that both sets of 
minority teachers shared very similar perceptions of the relative importance of the enabling 
skills. This information coupled with the information summarized in Table 18, provides 
substantial evidence in support of a highly agreed upon core of important enabling skills. 

Tabto 19 



Intercorrelation Matrix of Mean Ratings of Enabling Skill Importance 





Constftu#fit 


Prtmarv T««eh«r 


Suppi«fn«ntarv 


ConslitiMfit 




.97 


.92 


rnciuvy iwofwr 






M 


SuppkMiMfitary T«Aoh#r 
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Tabte20 



Intercorreltion Matrix of Profiles of Mean Importance Ratings for Black and Hispanic Teacher 
Respondents: Primary and Supplementary Groups 



Suppt«fn«titary TMch«r RMpondwiU 


PHmarv TMoh«r RMPond«ntt 


Stock HItiMinie 


Bteok 


.96 SPt 


Htopenie 


.90 .91 



Mean Importance Ratings of the Six Enabling Skill Dimensions 



In order to obtain an overall rating of enabling skill dimension importance, the mean 
importance for each of the six enabling skill dimensions was calculated for the three respondent 
groups. The means were computed by summing the importance ratings for each of the enabling 
skills within a particular dimension and then dividing by the number of enabling skills. The 
means and standard deviations are presented in Table 21. As illustrated, all the dimensions 
were judged to be important (scale value of 4) by the three groups. 

Table 21 



Mean Importance Ratings of the Six Enabling Skill Dimensions 





Constituent 
Rsspondsnts 


Primary TsaefMr 
Rsspondsnts 


Suppismsntary 
Tsaelisr Rsspondsnts 




Msan 


S.P. 


Msan 


S.D. 


Msan 


S.D. 


EnabHng sun OtmwitkMi 














RMdtng 


4^ 


0.S2 


4.07 


0.8t 


4.09 


04» 


Writing 


4.47 


0.70 


433 


0.77 


4.35 


0.52 


MMIUMIIHIIIUS 


4.02 


a92 


3.83 


1.03 


3.86 


0.87 


SpMkins 


4.47 


0.71 


4.50 


0.68 


4.42 


0.54 




4.20 


0.S4 


4.07 


0J8 


4.03 


04(2 


inttfottv Communioation Skills 


4.29 


0.75 


4J24 


0.77 


4.20 


0.52 



Verification of Content Domain Coverage 



To determine if the enabling skills content domain was perceived to be comprehensively 
defined^ the respondents indicated (at the dimension level) how well the survey covered the 
important enabling skills. These judgments were made using a 5-point rating scale ranging from 
1 (poorly) to 5 (very well). The results of these judgments are presented in Table 22. All three 
groups of respondents perceived the enabling skills content domain to have been well defined (a 
rating of at least 4.00). 
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Table 22 



Mean Ratings of Content Domain Coverage 





ConttHuant 
R— pondanf 




Primary TMchor 
Rasponctonts 


Suppl«m«ntary 
Taachar Raspondants 




MEAN 


S.D. 


MEAN 


S.D. 


MEAN 


S.D. 


Enabling Skill Dimension 














RMdIng 


4.47 


0.69 


4.29 


0.97 


4.30 


0.82 


WHting 


4.4« 


0.62 


4.28 


0.97 


4.35 


0.76 


MattMcnatlM 


4^4 


0.77 


4.01 


1.12 


4.16 


0.89 


SpMkIng 


4.51 


0.68 


4.39 


0.95 


4.46 


0.78 




4.4S 


0.67 


4.35 


0.97 


4.43 


0.82 


tntmraetfvtt Communication Sklllt 


4.33 


0.79 


4.23 


1.02 


4.32 


0.76 



Recommen dations for Test Content Emphasis 



The respondents were instructed to estimate the number of examination items that they 
believed should be included from each of the enabling skill dimensions. They indicated this by 
distributing 100 points (in whole numbers) across the six dimensions. These judgments of 
relative weight (emphasis) are important because the assessment measures should not only 
reflect the most important enabling skills, but reflect them in their appropriate proportions 
(Standards for Educational and Psychological Testing, 1985). These weights are presented in 
Table 23. Both groups of teacher respondents believed that Reading, Writing, and Mathematics 
should receive the most emphasis. The constituent respondents also emphasized Reading and 
Writing, but believed that Interactive Communication Skills should receive slightly more 
emphasis than Mathematics. 

Table 23 



Mgfln Nymber Of Examination Items (out of lOO^ to be in c luded for Each Enabling Skin Dimension 





Conatituant 
Raapondanta 




Primary Taachar 
Raapondanta 


St4pplamantary 
Taachar Raapondanta 




MEAN 


S.D. 


MEAN 


S.O. 


MEAN 


S.O. 


Enabling SMII DImantlon 














Raading 


20.36 


6.17 


20.91 


7.38 


22.19 


7.33 


Writing 


18.21 


5.19 


17.82 


6.41 


17.76 


5.50 


Maltiamatioa 


15.94 


5.87 


16.88 


7Ji2 


18.31 


7.42 


^paaklnp 


14.42 


4J6 


15.50 


6.35 


14.99 


5.56 


Ualaning 


14.24 


4J6 


15.07 


6.21 


14.92 


5.93 


Intaraotiva Communication Sklllt 


16.89 


7.14 


14.85 


7.81 


13.81 


6.54 
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Conclusions 



The purpose of this study was to identify a core of important enabling skills for entry- 
level teachers on which there is substantial agreement by practicing teacher and constituent 
groups. This core will be used to guide the developmem of the Stage I assessmem measures. 
To identify the core, three groups of practicing professionals were administered (m survey 
format) an enabling skills content domain. Using a 5-point importance rating scale, they were 
instructed to judge the importance of each enabling skill for entry-level teachers regardless of 
school level or subject-matter they teach. To be considered eUgible for mclusion m the 
assessment measures it was recommended that an enabling skill's mean importance ratmg meet 
or exceed 3.50 (the midpoint between moderately important and very important on the ratmg 
scale) and fewer than 20% of the respondents judged it to be of Uttle importance or of no 
importance. These two standards were selected because it was beUeved that they significanUy 
decrease the probabiUty of any unimportant enabling skills being included in the assessment 
measures In addition, to decrease the likelihood that these standards may inadvertently exclude 
•critical" enabling skills, provision was made for the Test Development Committee to remstate 
skills that did not meet the standards, if the Committee could provide a strong rationale m 
support of its decision. 

Overall, 113 enabling skills (84% of the content domain) met both the frequency and 
mean standards. These enabling skills were judged to be important by aU practicing teachers 
and constituent groups. The result of this high convergence of judgment is that there is a strong 
empirical basis for the development of a single examination that is appropriate for aU teachmg 
candidates The results of this study should be used by the Test Development Conmuttee to 
develop examination specifications. There should be an expUcit and documented link between 
the results of this study and the specifications. In addition, the specifications should reflect the 
most important enabling skills identified (skills should be selected that are as far above the 3 JO 
standard as possfele, without impeding the content representativeness of the specifications). 
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INTRODUCTION 



Educational Testing' Service (ETS) is attempting to describe and define the 
^^,ui«^, ,vq ic fl^.t- «n ent ^-l>>v^1 teacherc; should possess. The information 
obtained from the questionnaire'wil l assist us in identifying the content to 
be included in the successor to the NTE. 

This questionnaire is divided into three related parts: 
PART I: DESCRIPTION OF ENABLING SKILLS 
PART II: RECOMMENDATIONS FOR TEST CONTENT EMPHASIS 
PART III: DEMOGRAPHIC INFORMATION 

It is important for you to complete M,T, THREE PART? of this questionnaire. 
Your cooperation and participation in this project is greatly appreciated. 
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PART I: DESCRIPTION OF ENABLING SKILLS 



The description of enabling skills included in this questionnaire has been 
developed in cooperation with teachers, administrators, and teacher educators. 

On the following pages you will find a list of six enabling skill areas and 
within each a list of specific enabling skills. The six enabling skill areas 
are: 



1. 


Reading 


2. 


Writing 


3. 


Mathematics 


4. 


Listening 


5. 


Speaking 


6. 


Interactive Connrnmication Skills 



For each specific enabling skill you will be asked to make the following 
judgment using the rating scale below: 



Rating Scale 



Regardless of the subject-matter area or grade they 
teach, how IMPORTANT is it that all ENTRY-LEVEL 
teachers be able to do the following? (Circle the 
number on the scale that best reflects your judgment.) 



Using the Rating Scale 



(1) 



Of no importance 



(2) 



Of little importance 



(3) 



Moderately important 



(4) 



Very important 



(5) 



Extremely important 
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Regardless of the subject area or grade they teach, how Important Is it that all entry-level 
teachers be able to do the following? 



Circle your response using the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very Important 

5 Extremely important 



msnm 

A. 



IMPORTANCE 



Understanding the content of a reading selection. Entry-level teachers 
should be able to 



1. Determine the main idea or gist of a reading 
selection. 

2. Locate important ideas in a reading selection and 
explain why these ideas are important. 



1 2 3 4 5 



1 2 3 4 5 



3. Identify accurate paraphrases or sximmaries of ideas in 1 2 3 4 5 
a reading selection. 

4. Determine the supporting ideas in a reading selection: 12 3 4 5 
ideas, details, or facts that support the author's 

main idea. 

B. Understanding the argument of a reading selection. Entry level teachers 
should be able to 

5. Recognize the presence of an argument in a reading 1 2 3 4 5 
selection. 

6. Determine whether facts or ideas are relevant to an 1 2 3 4 5 
argument in a reading selection. 

7. Identify particular strengths or weaknesses in the 1 2 3 4 5 
author's arguments. 

8. Recognize the various persuasive techniques used by an 1 2 3 4 5 
author in a reading selection. 
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Regardless of the subject area or grade they teach, how Important is it that all entry-level 
teachers be able to do the following? 



Circle your response using the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Koderately important 

4 Very important 

5 Extremely important 



I. READING (continued) IM?QRTANCS 

9. Recognize elements of a reading selection that are 1 2 3 4 5 
intended to arouse emotions of the reader or to 
manipulate his or her thinking in a particular 
direction. 



10. Identify logical assumptions upon which the author 
bases the argument of a reading selection. 

11. Recognize the point of view used by an author. 



1 2 3 4 5 



1 2 3 4 5 



C. Understanding the Implied content of a reading selection* Entry-level 

teachers should be able to 



12. Perceive what is implied rather than directly 12 3 4 5 
stated by the author and make inferences from the 

directly stated content of a reading selection. 

13. Recognize the attitude expressed in the reading 1 2 3 4 5 
selection by the author toward his or her 

subject. 

14. Recognize the style or manner of expression used 12 3 4 5 
by the author. 

15. Distinguish between what a writer presents as 1 2 3 4 5 
fact from the writer's opinions. 

16. Recognize or predict ideas or sit\iations that are 1 2 3 4 5 
extensions of what has been presented in a 

reading selection. 

17. Determine the author's purpose in writing a 1 2 3 4 5 
reading selection. 
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Regardless of the subject area or grade they teach, how Important is it that all entry-level 
teachers be able to do the following? 

Circle your response using the 5-point scale next to each action. 

Of no importance 
Of little importance 
Moderately important 
Very important 
Extremely important 

I. READING (continued) ItffQRTANCE 

D. Understanding the organization of a reading selection. Entry-level 

teachers should be able to 

18. Understand how a reading selection is organized 1 2 3 4 5 
(e.g. , compare and contrast, problem and 
solution, description). 

19. Use the table of contents, section headings, 12 3 4 5 
index, and similar sections of a book to locate 
information. 

20. Arrange the ideas in a reading selection into an 1 2 3 4 5 
outline, a concept map, or into some other form 
of graphic organizer. 

21. Identify the relationships aaong ideas directly 1 2 3 4 5 
stated in the reading selection (e.g., 
relationships of cause and effect, and sequence). 

22. Determine implied relationships between general 1 2 3 4 5 
and specific ideas in a reading selection (e.g., 
a paragraph on the causes of the Civil War and a 
n\imber of specific examples of what might hav« 
caused them) . 

23. Locate the place in a reading selection where a 12 3 4 5 
specific kind of infor.^ition can be found (e.g., 
The author mentions the gestation period of ducks 
in paragraph? ) . 
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Regardless of the sxibject area or grade they teach, how Important is it that all entry-level 
teachers be able to do the following? 



Circle your response using the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very important 

5 Extremely important 

T. READING (continued) IMPORTANCE 

E« Understanding the way in which language is used in a reading selection* 

Entry**level teachers should be able to 

24. Recognize and identify different interpretations 12 3 4 5 
that can be made of the same word, sentence, 

paragraph, or reading selection. 

25. Identify what the author assximes that a reader 1 2 3 4 5 
knows when a specific word. or phrase is used. 

26. Recognize how the meaning of a word, sentence, or 1 2 3 4 5 
paragraph is affected by the context in which it 

appears . 

27. Determine the meanings of figurative language in 1 2 3 4 5 
a reading selection (e.g., "heart of a lion"). 

28. Understand the function of key transition 1 2 3 4 5 
indicators in a reading selection (e.g., 

"however*, "by contrast", "in conclusion"). 

F. Understanding other features of a reading selection. Entry-level 

teachers should be able to 

29. Compare or combine ideas or information found in 12 3 4 5 
two or more sources. 

30. Identify inconsistencies or differences in points 12 3 4 5 
of view in a reading selection or two or more 

such selections. 

31. Specify appropriate reference sources for 12 3 4 5 
locating a specific kind of information (e.g., 

for synonyms, use a dictionary or a thesaums, 
for information about the weather, use a 
newspaper or almanac). 
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Regardless of the subject area or grade they teach, how important; is it that all entry-level 
teachers be able to do the following? 

Circle your response vising the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very important 

5 Extremely important 



I. I^EADING (continued) 



32. Understand reading materials with various writing 
styles and various difficulty levels. 



TMPORTANCE 
1 2 3 4 5 



II. WRITING 
Conmoslng Skills 
33. 
34. 

35. 
36. 



37. 
38. 

39. 
40. 

41. 
42. 



Describe an event or sittiation. 

Delineate the steps in a process or procedure 
(e.g., explain how to do something). 

Support a position for or against something. 

Analyze ideas and information in various ways, 
for instance, 

-explaining the cause and effect of something 
-comparing and contrasting different points of 
view 

-drawing conclusions based on evidence provided 
Provide a clear focus or thesis. 

Produce and develop supporting material that 
explains or illustrates key ideas. 

Organize ideas effectively and logically. 

Use vocabulary appropriate to the purpose of 
writing and the audience addressed. 

Present ideas in writing in an imaginative way. 

Present alternative points of view in writing. 



1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 



1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 
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Regardless of the subject area or grade they teach, how important is it that all entry-level 
teachers be able to do the following? 



Circle your response using the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very Important 

5 Extremely important 

II. WRITING (continued) IMPORTANCE 

43. Produce writing that is free of errors in grammar, 12 3 4 5 
punctuation, and spelling. 

Editing and Revising Skills 

44. Recognize basic grammatical errors in standard 12 3 4 5 
written English. These errors might involve: 

-verb forms (had brung) 
-verb tense (yesterday I am making) 
-agreement of stibject; and verb (one of the books 
are) 

-pronoun case (between him and I) 
-punctuation ("it's" when "its" is meant) 

45. Recognize effective sentence structtire free of 1 2 3 4 5 
problems. These problems might involve: 

-misplaced modifiers (Not this: This computer is 
seldom used even though it is the most effective 
because of the high cost. But this: Even though 
it is most effective, this computer is seldom used 
because of the high cost.) 

-faulty subordination (Not this: Seeing the boat 
in the water, it hardly looked seaworthy. But 
this: Seeing the boat in the water, I decided 
thit it hardly looked seaworthy.) 

-faulty parallel structure (Not this: She 
promised to buy a copy of the book and that she 
would make it available to students. But this: 
She promised to buy a copy of the book and to make 
it available to students.) 
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Hegardless of the subject area or grade they teach, how important is it that all entry-level 
teachers be able to do the following? 

Circle your response ixsing the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very important 

5 Extremely important 



II • WRITING (continued) IMPORTANCE 

46. Recognize language that creates an inappropriate 12 3 4 5 
and/or inconsistent tone, given the intended audience 

and purpose for writing. Such inappropriate language 
might involve: 

-colloquialisms or slang in a formal report 
-sarcasm in a letter when respect is intended 

47. Revise sentences to correct basic problems in 12 3 4 5 
standard written English. These problems might 

include : 

-"had went" for "had gone" 
-"accept" when "except" is intended 

48. Revise paragraphs to create appropriate and 12 3 4 5 
consistent tone, given the intended audience and 
purpose for writing. These paragraphs might be 
excerpts from: 

-an explanation to a group of students 
-a proposal to a school board 

49 • Revise paragraphs to clarify meaning. The revision 1 2 3 4 5 

might address confusion resulting from such problems 
as: 

-illogical transitions 
-unnecessary repetition 
-vague references 
-imprecise language 
-irrelevant ideas 
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Regardless of the subject area or grade they teach, how iffipgrt^nt is it that all entry-level 
teachers be able to do the following? 

Circle your response using the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very important 

5 Extremely important 



in. MATHEMATICS IMPQRTAy<^E 

50. Recognize the position of niambers in relation to each 
other (e.g., 1/3 is between 1/4 and 1/2; -7 < -4). 



51. Recognize equivalent forms of a number (e.g., 1/2 - 
2/4 - 3/6 - 4/8 . . ; 1/10 - 0.1 - 10'* - 10%) . 

52. Solve problems by estimating answers (e.g., arrive at 
a reasonable, but not necessarily exact, answer by 
using a minimal amoxmt of computation) . 

53. Use the form of a number that is appropriate in the 
context of a problem (e.g., rounding to the nearest 
whole number) . 

54. Demonstrate an understanding of the characteristics 
of counting nximbers (e.g., prime or composite, even 
or odd) . 

55. Interpret and apply ratio, proportion, and percent in 
appropriate sitxiations. 

56. Perform computations (e.g. , addition, subtraction, 
multiplication, division) in problem solving 
sitxiations. 

57. Read and interpret information contained in various 
kinds of graphs (bar, line, circle, pictographs) , 
charts, and tables. 

58. Recognize relationships in numerical data (e.g., 
compute a percentage change from one year to the next) . 



1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 
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Regardless of the subject area or grade they teach, how l^p9r^^nt is it that all entry-level 
teachers.be able to do the following? 

Circle your response using the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 
Very important 
Extremely important 



MATHEMATICS (continued) 



IMPORTANCE 



59. Demonstrate an ability to analyze and sximmarize 
numerical data. 

60. Interpret common measures of central tendency: mean, 
median, mode. 

61. Interpret common measures of dispersion: range, 
variance, standard deviation. 

62. Select a sequence of operations that could be used to 
solve a problem. 

63. Recognize the relationships among the variables 
and/or constants in an equation or formula (e.g.. If 
A - bh/2 . then h - 2A/b) . 

64. Solve simple equations. 

65. Write equations using variables to represent 
situations presented in words. 

66. Recognize patterns and spatial relationships through 
observations of geometric figures (e.g., seeing the 
right triangles in a cube). 

67. Use formulas for determining length, area, and volume 
of common two- and three-dimensional geometric 
figures. 

68. Understand and use various systems of measurement, 
including the metric and U.S. customary systems; make 
conversions within the same system. 

69. Convert units from one measurement system to another 
using a conversion table. 



1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 
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Regardless of the subject area or grade they teach, how important is it that all entry-level 
teachers be able to do the following? 



Circle your response using the 5-point scale next to each action, 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very important 

5 Extremely important 

MATHEMATICS (continued^ IMPORTANCE 

70. Interpret sentences containing logical connectives 12 3 4 5 
(and, or, if-then) and quantifiers (some, all, none). 

71. Use deductive/inductive reasoning to determine 1 2 3 4 5 
whether a conclusion based on a sequence of 

statements is valid or invalid. 

72. Draw correct conclusions; identify counterexamples to 12 3 4 5 
inappropriate conclusions. 

73. Recognize and demonstrate various ways to find 1 2 3 4 5 
answers to problems. 

74. Demonstrate fundamental algorithms (procedures) using 12 3 4 5 
real world situations (e.g., multiplication as 

repeated addition) . 

75. Use examples from the history of mathematics (e.g., 1 2 3 4 5 
the evolution of 19th century computing machines into 

the high-speed computers of today) . 

76. Express the key concepts of mathematics in a simple, 12 3 4 5 
straightforward manner. 

77. Use a calculator as a computational tool. 12 3 4 5 

78. Use a variety of materials to foster mathematical 1 2 3 4 5 
understanding (e.g., manipulatives , three-dimensional 

models , etc . ) 

IV. LISTENING 

79. Recall the actual wording of a brief spoken message. 1 2 3 4 5 
80* Recall and paraphrase a spoken message. 1 2 3 4 5 
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Regardless of the subject area or grade they teach, how imoyi^m^ is it that all entry-level 
teachers be able to do the following? 

Circle your response using the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very important 

5 Extremely important 

IV. USimfiG (continued) ^^^^^ 



81. Select the information contained in a spoken message 
which is relevant to answering a particular question 
or carrying out a particular task, (e.g., screening 
out information that is irrelevant to the question or 
task at hand, focusing on important specific details 
in a message, etc.) 

82. Recognize when a speaker has asked a question, and 
understand what is being asked. 

83. Understand implied content in a message, and 
recognize the difference between what speakers imply 
and what they directly affirm. 

84. Understand the meaning of figures of speech used in a 
spoken message (e.g., "my heart was racing," "a liar 
makes only slippery promises"). 

85. Interpret the purpose of a common rhetorical device 
(e.g., a repetition for emphasis or an analogy for 
clarification) . 

86. Recognize the overall organization of a spoken 
message (e.g., determine whether a speaker is 
primarily comparing and contrasting, narrating events 
in chronological sequence, describing a phenomenon, 
using a logical argument, etc.). 

87. Identify the main idea of a message, when the main 
idea is stated directly. 

88. Identify the main idea of a message when it is 
inferable on the basis of information in the message. 

89. Identify a speaker's purpose. 



1 2 3 4 5 



1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 



1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
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Regardless of the subject area or grade they teach, how important is it that all entry-level 
teachers be able to do the following? 



Circle your response using the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very important 

5 Extremely important 

'W, LISTENING (continued^ [ IMPORTANCE 

90. Recognize strengths or weaknesses in the logic of a 12 3 4 5 
speaker's arguments. 

91. Determine whether facts or ideas presented by a 12 3 4 5 
speaker as evidence in support of an argument are 

indeed relevant. 

92. Recognize internal inconsistencies in a spoken 12 3 4 5 
message (e.g., when a speaker gives contradictory 

information or makes statements that do not coincide 
with what he or she said earlier) . 

93. Determine whether statements in a spoken message are 12 3 4 5 
presented as facts or opinions. 

94. Identify assumptions on which logical argument in a 12 3 4 5 
spoken message is based. 

95. Identify the affective or emotional content of a 12 3 4 5 
spoken message. 

96. Focus on a spoken message when interfering or 12 3 4 5 
competing stimuli (e.g., noise or other distractions) 

are present. 

97. Understand oral instructions given by a speaker. 1 2 3 4 5 

98. Use cues such as pitch, tone of voice, stress, facial 12 3 4 5 
expression, or gesture to help understand the meaning 

of the spoken message. 

99. Recognize the existence of different regional and 12 3 4 5 
social varieties (dialects or subdialects) of spoken 

English. 

100. Understand different regional and social varieties 12 3 4 5 

(dialects or subdialects) of spoken English. 
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Regardless of the subject area or grade they teach, how important is it that all entry-level 
teachers be able to do the following? 



Circle your response using the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very important 

5 Extremely important 

V. SPEAKING IMPORTANCE 

101. Enunciate words to permit listeners to hear the words 12 3 4 5 
clearly. 

102. Speak in a fluent manner (e.g., without excessive 12 3 4 5 
pauses or "tims" or "ahs"). 

103. Speak at a rate in order to be understood by the 12 3 4 5 
audience . 

104. Speak loudly enough to permit listeners to hear. 12 3 4 5 

105. Use tone of voice to convey a specific attitude or 12 3 4 5 
message. 

106. Place stress appropriately to emphasize important 12 3 4 5 
information. 

107. Use eye contact, facial expressions and gesture 12 3 4 5 
effectively (e.g., to enhance comprehension of 
message or to encourage interaction) . 

108. Use grammatical structures correctly when speaking. 12 3 4 5 

109. Adjust the grammatical complexity of the language to 12 3 4 5 
the audience. 

110. Demonstrate a basic working vocabulary when speaking. 1 2 3 4 5 

111. Recognize when a message has not been 12 3 4 5 
understood by the listener or listeners. 

112. Supply a synonym for or explanation of a word that 12 3 4 5 
has not been understood. 
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Regardless of the subject area or grade they teach, how Important is it that all entry-level 
teachers be able to do the following? 



Circle your response xising the 5-point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very important 

5 Extremely important 

V. SPEAKING (continued) IMPORTANCE 

113. Adapt vocabulary and style of language to the 1 2 3 4 5 
situation and the audience, (e.g., use suitably 

formal or informal language, use language appropriate 
to the age of the listeners). 

114. Adjxist to an \inexpected change in the speaking 1 2 3 4 5 
sitxiation (e.g., when a student joins a group of 

teachers) . 

115. Use the spoken language for a variety of 12 3 4 5 
communicative purposes (e.g., to describe, explain, 

narrate, discxiss, ask and respond to questions, 
request, praise, deny, interact socially, etc.). 

116. Speak concisely and to the point. 12 3 4 5 

117. Read aloud with the intonation, inflection and 1 2 3 4 5 
fluency to communicate written material effectively. 

VI. INTERACTIVE COMMUNICATION SKILLS 

In addition to the preceding skills, interactive skills are also part of communicating 
effectively. 

118. Get a listener's attention before speaking. 12 3 4 5 

119. Give verbal or non-verbal feedback when listening to 1 2 3 4 5 
another speaker (e.g., indicate comprehension, 

agreement) . 

120. Exercise good judgement with regard to turn-taking in 1 2 3 4 5 
oral interaction. 
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legardless of the subject area or grade they teach, how tfflportm is it that all entry-level 
reachers be able to do the following? 

:ircle your response using the 5-point scale next to each action. 

Of no importance 
Of little importance 
Moderately important 
Very important 
Extremely important 



VI. 



TNTERACTIVK GQMMUNI^ lfrTTON SKILLS (continued) 

121. "Direct" verbal interaction (e.g., give equal 
speaking time to the people involved, probe for 
response, keep the interaction to a certain topic). 

122. Adapt to a variety of communicative sit\iations (e.g., 
small groups, large groups). 

123. Request clarification of a spoken message when it has 
not been understood. 

124. Be aware of a listener's non-verbal and verbal cues. 

125. Be aware of one's own non-verbal and verbal cues. 

126. Respond to signs that a listener is not understanding 
a message by paraphrasing or using examples. 

127. Match a spoken message to the audience's level of 
interest and knowledge. 

128. Refrain from interruptions that interfere with the 
speaker's opportunity to present his or her comments 
or point of view. 

129. Listen to a speaker and sximmarize the speaker's main 
ideas . 

130. Listen to two speakers and compare their points of 
view. 



IMPORTANCE 
1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 
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Regardless of the subject area or grade they teach, how important: is it that all entry-level 
teachers be able to do the following? 



Circle your response using the 5--point scale next to each action. 

1 Of no importance 

2 Of little importance 

3 Moderately important 

4 Very important 

5 Extremely important 



VI. 



INTERACTIVE COMMUNICA TION SKILLS (continued) 

131. Listen to someone describe a situation, read a 
different account of the same event, and explain how 
the two sources confirm and/or contradict each other. 

132. Obtain information from a variety of sources and 
synthesize the information. 

133. Listen to a discussion, evaluate the logic of the 
arguments, and draw one's own conclusions. 

134. Observe an incident, describe the incident, and 
hypothesize on its probable cause or predict the 
effect. 



IMPORTANCE 
1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
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ENABLING SKILLS 



Please use this space to list important enabling skill areas not included in 
the questionnaire (those included were reading, writing, mathematics, listening, 
speaking, and interactive communication skills) . 



Please use this space to list any specific enabling skills that were not 
included v»ithin each of the six enabling skill areas (e.g., did we leave out 
any important specific reading skills, mathematics skills, listening skills, e 
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CONTENT COVERAGE 



Please answer the following question by circling the number on the 5-point scale 
that best represents your judgment. 

How well do you believe this questionnaire covered the important enabling skills 
all entry-level teachers should possess? 

1. Reading 

1 2 3 4 5 

poorly somewhat adeqxiately well very well 

2. Hli^lDS 

1 2 3 4 5 

poorly somewhat adequately well very well 

3. Mathematics 

1 2 3 4 5 

poorly somewhat adequately well very well 

4. Listening 

1 2 3 4 5 

poorly somewhat adequately well very well 

5. Speaking 

1 2 3 4 5 

poorly somewhat adequately well very well 

6. Interactive Connnunication Skills 

1 2 3 4 : 

poorly somewhat adequately well very well 
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PART II: RECOMMENDATIONS FOR TEST CONTENT EMPHASIS 



Listed below are the six enabling skill areas that may be covered on the 
successor to the NTE. If the examination contained 100 questions, how many 
questions should be included for each enabling skill area? 

Please indicate your response by distributing (in whole numbers) a total of 
100 points across the six enabling skill areas listed below. 



Niirnhftr of Questions 
Enabling Skill Area (out of 100) 



1 . Reading 

2 . Writing 

3. Mathematics 

4. Listening 

5 . Speaking 



6. Interactive Communication 
Skills 



TOTAL 100 
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Demographic Section: Teachers 
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PART III: DEMOGRAPHIC INFORMATION 



Please answer the following questions by circling the niimber that most closely 
describes you or your professional activities. Please circle onlv one regpQnse 
for each question . 



135. Which of the following best describes the school district in which you 
work? 



1. Urban 

2 . Suburban 

3 . Rural 

136. What is your age? 



1. Under 25 

2. 25 to 34 

3. 35 to 44 

4. 45 to 54 

5. 55 to 64 

6. 65 or over 

137. How many years, including the current school year, have you been 
teaching? 



1. Less than a year 

2. 1 to 2 years 

3. 3 to 5 years 

4. 6 to 10 years 

5. 11 to 15 years 

6. 16 to 20 years 

7. 21 or more years 



138. What is your sex? 



1 . Female 

2 . Male 



139. Is your ethnic heritage Hispanic? 



1. Yes 

2. No 



140. Which of the following best describes you? 



1. Black 

2. White 

3. Asian or Pacific Islander 

4. American Indian or Alaska Native- 

5. Other . 
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DEMOGRAPHIC INFORMATION (continued) 



141. What is the highest professional degree you hold? 

1. Less than Bachelor's Degree 

2. Bachelor's Degree 

3. Bachelor's Degree + Additional Credits 

4. Master's Degree or Equivalent 

5. Master's Degree + Additional Credits 

6 . Doctorate 

142. Which of the following best describes your current employment 
status? 

1. Regular Teacher (not a substitute) 

2. Temporary Substitute (assigned on a daily basis) 

3. Permanent Substitute (assigned on a longer term basis) 

4. Other (please specify) 

143. Which of the following best describes the grade level at which 
you teach? 

1 . Elementary 

2 . Middle 

3 . Secondary 

144. Which of the following areas best describes your primary teaching 
assignment? (Circle only ONE category) . 

1. All or most school subjects 

2. Special education for handicapped or othf^r exceptional 
students including the gifted and talented 

3. Arts (e.g., fine arts, music, theater) 

4. Language Arts and Communication (e.g., English, foreign 
language, speech, literature) 

5. Mathematics and Computer Scifcoce (e.g., arithmetic, logic, 
statistics) 

6. Physical and Biological- Sciences (e.g., general science, 
biology, physics, chemistiry, geology) 

7. Social Sciences (e.g., social studies, psychology, 
sociology, economics , history, government) 

8. Home Economics 

9. Business and Vocational education (e.g., accounting, shop, 
craft skills, agriculture) 

10. Health and physical education 

11. Other (please specify)^ 
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DEMOGRAPHIC INFORMATION (continued) 



145. Which of the following ranges best represents the average 
(typical) class size you teach? 

1. 1 to 9 students 

2. 10 to 14 students 

3. 15 to 19 students 

4. 20 to 24 students 

5. 25 to 29 studv<5nts 

6. 30 to 3:^ s^-idents 

7. 35 or more students 



146 . In which state do you work? 



10. Florida 

11. Georgia 

12. Hawaii 

13. Idaho 

14. Illinois 

15 . Indiana 

16 . Iowa 

17. Kansas 



1. Alabama 

2. Alaska 

3. Arizona 

4 . Arkansas 

5. California 

6 . Colorado 

7. Connecticut 

8 . Delaware 

9. District of 



Columbia 



18. Kentucky 

19. Louisiana 

20. Maine 

21. Maryland 

22. Massachusetts 

23. Michigan 

24. Minnesota 

25. Mississippi 

26. Missouri 

27. Montana 

28. Nebraska 

29 . Nevada 

30. New Hampshire 

31. New Jersey 

32. New Mexico 

33. New York 

34. North Carolina 

35. North Dakota 



36. Ohio 

37. Oklahoma 

38. Oregon 

39. Pennsylvania 

40. Rhode Island 

41. South Carolina 

42. South Dakota 

43. Tennessee 

44. Texas 

45. Utah 

46 . Vermont 

47. Virginia 

48. Washington 

49. West Virginia 

50. Wisconsin 

51. Wyoming 



Thank you for completing this questionnaire. 
Please return it utth^n 1Q DAYS 
in the enclosed postage-paid envelope. 



D27 



ERLC 



8b 



Demographic Section: Constituencies 
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PART III: DEMOGRAPHIC INFORMATION 

Please answer the following questions by circling the number that most 
appropriately describes you and your professional activities, fl^^ge cj.rcle 
only one response for e ach question. 

1. What is your primary affiliation within the field of education? 

1. State department of education official (NASDTEC) 

2. Teacher educator (e,g,, dean, associate dean, professor) 

3. Elementary school principal 

4. Secondary school principal 
5 • Superintendent 

6. PTA representative 

7. State board of education representative 

8. State school board representative 

9. AFT representative 
10. NEA representative 

2. How many years, including the current year, have you been in your current 
professional position? 

1. Less than a year 

2. 1 to 3 years 

3. 4 to 6 years 

4. 7 to 9 years 

5. 10 or more years 

3. What is your sex? 

1 . Female 

2, Male 
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DEMOGRAPHIC INFORMATION (continued) 
Is yotir ethnic heritage Hispanic? 

1. Yes 

2. No 

Which of the following best describes your racial background? 

1. Black 

2. White 

3. Asian or Pacific Islander 

4. American Indian or Alaksan Native 

5 . Other 

What is your age? 

1. Under 25 

2. 25 to 30 

3. 31 to 36 

4. 37 to 42 

5. 43 to 48 

6. 49 to 54 

7 . 55 or over 

What is the highest academic degree you hold? 

1. Less than Bachelor's Degree 

2. Bachelor's Degree 

3. Master's Degree 

4 . Doctorate 

030 
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DEMOGRAPHIC INFORMATION (continued) 



rxe&se circie une 






AiaDama 


is.enu\icKy 


Nofth Dfllcotfl 


AiasKa 


i^OU i S> i. cHici 


OHi o 


Arizona 


fiaine 




Arkansas 


Mil wl 


Oregon 


oaliromia 


nassciCiiU2>c L. L.s> 


Pftn"nsvlvani_a 


Colorado 


Kfl /^T^ 4 cram 

nxcnxgan 




uoniiec u^cuu 




South Carolina 


Delaware 




South Dakota 




Ml co/\iit*i 


Tennessee 


r lorxca 


Mm^ a a 


Texas 


Georgia 


ri c iJ cio Net 


Utah 


Hawaii 


nevacxa 




Idaho 


New Hampshire 


Virginia 


Illinois 


New Jersey 


Washington 


Indiana 


New Mexico 


West Virginia 


Iowa 


New York 


Wiscons in 


Kansas 


North Carolina 


Wyoming 



Thank you for completing this questionnaire. 
Please return it in the enclosed postage-paid envelope. 
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Appendix E 

Sample Letters of Invit ation to Participate 
in the Job Analysis Survey 

• Tonstitiient Group 

• Primary Teacher Group 

• Su pplementary Teacher Group 




Constituent Group 
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AMERICAN ASSOOAnON 
OF SCHOOL ADMINISTRATORS 



May 23, 1989 



Dear Colleague: 

We are writing to ask the help of members of the AASA 
SxeJivrCo^^ittee and state association presidents and 
executive directors. 

n. Educational Testlns Ser.lc (S'S) ia 

H:r:ri.;rraH;.:r;-.^;e!rr-^ir.i.i^^ 

of this examination. 

• a cart of t», proo.aa of id.ntlfying "enabling aklUa,- ET3 

haa -o^ad "loaaly -it» taacn.ra. ""-^/^'^f '"^^ta "h 
anrf local levels, teachers trainers, and parents. me 

:"roatd%i:ationnair.'haa ba.n .IJ.'l'' 
judgm.nta on tn. liportano. of ^S?ainl fro. you and 

2:C".t".'iirL"tar?rri"i:;a £a Ul^^.ud ad .0 

be most important by administrators, and that data wiii 
reflected in the actual exam. 

we urge you to take the time to complete the «"°l<=3ed 
questionnarre! A preliminary study h..s indicated that the survey 
requires about 30 minutes to complete. 

Please return your completed question:iaire within 10 days in 
the enclosed postate-paid envelope. 

Ms -.anks for your cooperation and participation in this 
most ir Ant project. 

Sincerely 



Richard Miller 
Executive Director 



(703) 52S0700 • Fax (703) 84V1543 
T801 Nortti Moor» Str»«t • Arllnoton. 22209 



Primary Te acher Grnu\> 
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ERIC 



IDUCATIONAL TESTING SERVICE JE, PRINCETON. N.J. 08541 



Gregory R. /Aftng 
Pmtdtnt 



October 6, 1989 



Dear Teacher: 



W. need your help with an l^aportanc study of teaching being conducted by 
Educational Testing Service (ETS) . As you are undoubtedly aware the 
Sof «s!^ is re«!ving increasing national press as new plans and Programs 
arf proposed for"sses!ing teaching. The purpose of this study ts "describe 

TfL. the enabling s1.ills (e.g.. reading »f ^^^J' -^^'^^^j: :Sict'che 
»^ir^r,a slelllsl that all entry-level teachers should possess. We expect tne 
HsS?? o!; tie'sSSy ^o receSe a great deal of attention among the various 
constituencies and interest groups in education. 

You were chosen to participate in this study as a member of a carefully 
selected sample of teachers. The sample is intended to be broadly 
r!p«sIntaS^e of teachers throughout the United States. fj/^J;" ,f » 
sS^ey lilc. this one is directly related to the ^^^^-^^^J^'^/^^ 
return their cjuestionnaires . Because you represent a larger number of 
"H^rs with characteristics similar tc your own. your responses are very 
istporirant: to us . 

The enclosed questionnaire aslcs you to react to a description of 
enabling skills and to express your views about the importance of each for 
entry-ievel teachers. 

The information you provide will ultimately be used to guide the 
develoStn^lfTsiccessor'to the ...tional Teacher VlJtVZ'^ 
that ETS is undertaking in response to concerns expressed by the teaching 
^t^i^y ln^to reflect new developments in the are. of teacher 
it^ sLe time, the study represents «i Important contribution in its own 
iUt to^ ^d;rstaading of teaching as a profession. This ^ 
^systematic studies eJer undertaken of teaching, and we expect the results 
CO be widely disseminated. 

Tour responses will be treated fs confidential. You will notice that ve 
ask for^mrSJou^d information about you; this is solely for purposes of 
5«crJbiJg the saiple of teachers. If you provide your name. w. will ""^ you 
i leSef ?hit th^ you for your participation in the study; the^-«« 
Je added to your personnel file or given to your supervisor. Under no 
ctrJumltancel will your name appear in connection with your responses, which 
will be reported only in the form of group suamaries. 



[Yo 



2 



A postage-paid «txv«lop« is •nclosed for cha raturn of yoTir completed 
quest iJi^irt* ?lease retuL the questionnaire within ten days . " 7°-^*:' 
2^"qu.stions about the study or abov.t your P«f ^JPf " 
call Dr. Richard Tannenbaua. collect, at 609-921-9000 Ext. 5279. 

Thank you for your cooperation in what we feel is an exciting and 
inportant Trencvire. 

Sincerely, 





rregbry R. Anrig 



Endostire 



If you would like a letter that acknowledges your participation in this study. 
pleL. pro^de your name and preferred address (if different from nailing 
label) belov. 
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Sn pplementarv Teache r Group 
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EXECUTIVE OFFICE 

NATIONAL EDUCATION ASSOCIATION • 1201 leih si. n-w., Washington. 0 c 20036-3290 • (202) 822-7000 

OON CAMERON. Cxacutiv* Director 



KEITH GEIGER. Pr^tuS^t 
R08HRT CHASH. Vic« Prwid«nt 
ROXANNE E. BRAOSHAW. S«cr«tiryTr««4«ir»r 



January, 1990 
MEMORANDUM 



TO: Selected NEA Members 

FROM: Ke|tli:;;^iger 

RE: Assistance with ETS Survey 



I am writing to asJc your assistance with an imporriant project 
vmderway at the Educational Testing Service (ETS) • 

As part of its redesign of the National Teacher Exaunination (NTE) ; 
ETS is conducting a nationwide survey of classroom teachers seeking 
their responses to questions on enabling skills for teachers* 

The sxirvey is an importzmt element of the job analysis phase of the 
NTE redesign. Teachers from elementary, middle, and secondary 
schools will identify the enabling skills necessary for beginning 
teachers, and therefore, will help shape the content of future NTE 
questions. As such, ETS is concerned that the respondent pool be 
adequately representative of ethnic minorities and has asked the **" 
NEA's assistamce in ensuring this representation. 

The NEA is supportive of ETS' effort to improve the National 
Teachers Examination and believes that teacher input to the design 
of the NTE successor is essential. We also agree with ETS that the 
juccessor to the NTE must be sensitive to the opinions and 
prioritises of as broad a range of teachers as possible. Therefore, 
I ask th^dt you complete the enclosed survey form and return it to 
ETS in the enclosed envelope. 

ETS policy is to treat all survey responses as confidential. 
Inquiries about this project can be directed to Patricia Bukatko of 
ETS at (609) 734-5193 or to NEA-IPD at (202) 822-7350. 

Thank you for your cooperation. 
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Appendix F 
Constituent Respondent s: Results 
of Frequency and Mean Analyses 



Fl 

i)9 



CONSmUEHT RESPONDENTS 
N-289 





L/N* 


PERCENT 

V/E 


Maan 




READING 










1. D«l8rfiiln« main td«a 




99 


4.85 


0.45 


2. Locato Important ki«ftt 




98 


4.73 


0.57 


3. Idatttlfy accurata paraphraoaa 




85 


4.35 


0.78 


4. Datarmloa supporting Idaaa 




89 


4.42 


0.72 


5. Raoogniza an argumant 




93 


4.51 


0.04 


«. Dalarmina faeta/ldaaa 




94 


4.51 


O.o3 


7. klantify atranglh/waaknaaa 


2 


81 


4.19 


0.79 


Raeogniza tachniquaa 


5 


86 


3.89 


A OA 

O.oV 


g. Raeogniza alamanta 


2 


81 


4.19 


0.79 


10. ktantify logical assumptions 


2 


80 


4.17 


0.78 


11. Raoogniza point of viaw 


1 


81 


4.25 


0.78 


12. Paroalva wtiat Is impllad 


2 


84 


4.20 


0.77 


13. Raoogniza attHuda axprassad 


2 


76 


4.05 


0.79 


14. Raoogniza styla 


7 


49 


3.58 


0.59 


IS. DIstingulah facts/opinion 


1 


94 


4.5o 


U.9o 


16. Raoogniza Idaas/sHuatlons 


3 


67 


3.89 


0.80 


17. Datarmina author's purposa 


5 


68 


3.94 


A A4 

O.vl 


IS. Undaratand raading salactions 


3 


73 


4.01 


0.86 


19. Usa tabia of contants 


1 


94 


4.69 


0.59 


20. Anranga Maaa in raading salaction 


5 


80 


4.14 


0.87 


21. Idantffy ralatlonshlps 


2 


80 


4.15 


0.81 


22. Dalarmina impllad ralationshlps 


3 


78 


4.06 


0.79 


23. Locala piaoa In raading salaction 


9 


69 


3.96 


1.02 


24. Raoogniza dmarant Intarpratatlons 


1 


80 


4.20 


0.77 


25. Manltfy «rfrat author assumaa 


6 


60 


3.76 


0.87 



*L/N - of Ittiki or fw Importinc* 
^f/E ■ very or •xtr«mo(y ImporUnt 
• L/N > 20% 
t Mmh of toM than 3^ 
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CONSTITUENT RESPONDENTS 





L/N 


PERCENT 

V/E 


Maan 


S.D. 












26* R^oogniM tiMMining ot word 


1 


vO 


4.41 


A 


27. DclMiiiiiM mMnIng of figuration 


3 


7a 


4.UM 


A ftl 


» • -1 ^— « • M» ■ f_ . turn 1 f > 

28. Unof ttfun fiinctiorH(«y transit. 






A tVt 


A AA 


29. Cocnpar«/comt>in« ki#aft 


1 


OO 


A 9fl 


A 


90. loaiiiiry inoonaiatancMs 




ftft 
OO 




0 7A 


31* Spadfy appfopHata rafaranca sourca 


1 




A aa 




32. Undaral md raading matariaia 


2 


oo 


4.10 


w.7v 


wIhiMG 










33. Daacnba an avam/sltuation 


1 


OA 


4.0o 


A ai 

W.01 


34. Dallnaala atapa !n a procaaa 


1 




A 79 


A AA 
V.P4 


35. Support a position 


1 




4.44 


A AA 


3a. Analyza tdaaa 


1 


yi 


A AA 
4.40 


A 7A 


37. Provkla a claaf focua 


* 

1 




A AK 


A Aft 


09* r'KMiuoa/Qvwiop supp. iiMiivriais 


A 
w 


91 




0.67 


39. Organlza klaaa 


1 


Q7 
w7 


A AO 


A A1 


ao. uaa vocaowary appropriany 


4 

1 




A as 


0 61 


41. Iras ant looaa in writing 


z 






A A1 


mL» rt^m9m BHWiiHUva pvifua 




7fi 


4.05 


0.78 


43* Prodfjoa writing fraa of anrora 


1 


93 


4.66 


A Aft 

O.OQ 


14. Racogniza Daalc grammatical arrora 


1 


96 


4.79 


0.55 


45. Raoogniza affactiva santanca stnictura 


1 


93 


4.52 


0.66 


46. Raoogniza Inappropriata languaga 


1 


84 


4J23 


0.75 


47* Raviaa santancaa 


1 


96 


4*66 


0.62 


4i. Raviaa paragrapha to craata 


1 


69 


4.33 


0.66 


49. Raviaa paragrapha to clarify 


0 


91 


4.37 


0.65 
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9L MATHEIiAIICS 

50. R«oogni2« position of numbers 

51. Rooognizo oquivalont forms 

52. Soivo problsms 

93. Uso approfirlsis form of numbsr 

54. Dsmonslrals charsct of counting #'s 

55. intsrprst and apply ratio 

56. Parform computations 

57. Raad/imarprat various graphs 
51. Racognlza numarical data 

59. Damonatrata ability to analyze 

60. intarprat IMaan, IMadlan, IModa 

61. intarprat Ranga, Varianca, S.D. 

62. S ala ct saquaoca of operations 

t 63. Raoogniza ralationslilps among variablas 

64. Solva simpla aquations 

65. WHIa aquationa using variablas 

66. Raoogniza pattams 

67. Uaa focmulaa for datarminlng langtii 
66. Ua6 varioua systams of maasuramant 
60. Cofivart unlta • maasuramant systam 

70. imarprat logical connactivaa 

71. Uaa daducHva/inductiva reasoning 

72. Draw oorract conclusions 

7X Damonatrata ways to find answers 
74. Damonatrata fundamental algorithms 
t* 75. Uaa axampiae from history of math 



CONSmrUENT RESPONDENTS 



L/N 


PERCENT 

V/E 


Mean 


S.D. 


1 


02 


4.51 


0.66 


2 


68 


4.40 


a74 


1 


84 


4.27 


0.75 


2 


82 


4.16 


0.77 


3 


78 


4.11 


0.85 


2 


87 


4.24 


a72 




97 


4.70 


0.58 


1 


91 


4.44 


0.70 


i 


83 


4.16 


0.75 


1 


80 


4.13 


0.75 


2 


69 


3.93 


0.80 


g 


SO 


3.58 


0.88 


2 


82 


4.17 


0.76 


15 


46 


3.47 


0.99 


4 


79 


4.19 


0.89 


10 


55 


3.63 


0.96 


11 


50 


3.57 


a94 


6 


58 


3.73 


a92 


8 


60 


3.81 


0.96 


7 


64 


3.83 


0.91 


3 


69 


3.97 


0.85 


4 


78 


4.10 


0.64 


5 


72 


3.99 


0.87 


3 


84 


4.23 


0.84 


9 


64 


3.63 


0.95 


34 


22 


2.90 


0.97 
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CONSTITUENT RESPONDENTS 





PERCENT 

t/N 


V/E 


Mean 


S.D. 


MATMEMATICS (oonf A 












3 


78 


4.22 


0.89 


7T IIa* ralriilatnr *a tool 


3 


83 


4.30 


0.82 




10 


66 


3.92 


1.03 












TO nairlt ■ntnal u<ArHti%n Aff niMaaafiM 


14 


61 


3.73 


1.05 




1 


94 


4.50 


0.68 




■J 


93 


4.48 


0.69 






97 


4.64 


0.61 


1t!!L ttiylotfitaiMl tmollod cont. In iiMftsaOft 

0«p« UtH^^WMNfU •lllfAIWM III ••■•••■Tf^ 


1 


87 


4.28 


0.72 


O'v* WtlV^n VMHnS ■■•^•lllll^ Wl lly* Wl •f' WW(I 


4 


75 


4.03 


0.82 




g 


65 


3.80 


0.85 


UM. DaaaaaIva Araflnty •snAkAA ntAftftMlA 


4 


67 


3.90 


0.86 


87 ktent. mMkn IdM of inftSSAaA«dlr#ctlv 


1 


97 


4.71 


0.57 


SA. Ifloiit main IdoA of niAfts-infftrablft 


1 


92 


4.43 


0.69 


OV* iMWIlMiy 41 Vf^NV^W • pvi fA/«W 


2 


91 


4.45 


0.72 


OA PpAAAnly itf iifith i^wlrnAAt In loalc 

^^f» nwVA^|INAV wl^JMI/ WW«Wllw»« III I^^JIV 


1 


86 


4J20 


0.69 




1 


86 


4.26 


0.74 


Q9. Dotemilno atrntomynta aro fact/ODlnion 


2 


88 


4.28 


a7i 


IdiiMftf iiAals of UmiIcaI ArQunwit 


1 


90 


4.44 


0.68 


9#* HKMiiiiy MSMfnpuon ot i09* wQunivnT 


i 

1 


78 


4.04 


0.72 


95. kkKiUfy «flMttv«/«motlon«l content 


3 


73 


3.96 


0.78 


96. Focus on a tpokon motsago 


6 


72 


3.97 


0.93 


97. Understand oral Instructions givsn 


1 


96 


4.66 


0.60 


99. Us« cuos SUCH as pitch 


2 


79 


4.15 


0.81 


99. Rsoognizs dialocU of spoksn English 


8 


60 


3.81 


1.00 


100. Undmtand spoksn English dialscts 


12 


53 


3.58 


ao8 
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CONSTTTUENT RESPONOENtS 







L/N 


PERCENT 

V/E 


Moan 


S.O. 


V. SPEAKMG 










101. 


EmmdM words 




95 


4.65 


0.66 


102. 


Spmk In fkMfit manner 




91 


4.46 


0.72 


103. 


Spmk at rM» to bo undorstood 




95 


4.56 


0.63 


104. 


Spook Soudly to bo hoard 




94 


4.62 


0.63 


105. 


Uoo toAO of voifto to convoy mosaago 




87 


4.28 


0.7^ 


100. 


Ptaco siroaa appropriatoly 




89 


4.32 


0.71 


107. 


Uao oyo oontact 




88 


4.42 


0.74 


100. 


Uao grammatical ttructuro corroctty 




96 


4.67 


0.61 


109. 


Ad]uat grammatical comploxk>7 




89 


4.41 


0.75 


110. 


Oomonatralo baalo working voct bulary 




94 


4.56 


0.65 


111. 


Rooognizo moaaago not undorstood 




98 


4.68 


0.58 


112. 


Supply synonym for a word 




92 


4.44 


0.68 


11X 


Adapt vocabulary and stylo of long. 




91 


4.45 


0.72 


114. 


Adjust to unoxpoctod change 




82 


4.12 


0.82 


115. 


Uao spokon long, for varloty of purp. 




94 


4.50 


0.65 


110. 


Spook oondaoly and to tho point 




93 


4.46 


0.67 


117. 


Road aloud with Intonation 


3 


87 


4.30 


0.79 


VL 0fYEIIAC7IVE COMMUNiCATKM StOtLS 










118. 


Got a Hatsnor's attontlon 


2 


92 


4^ 


0.75 


110. 


Qlvo vofbal/non^orbal foodback 


2 


82 


4J22 


0.80 


120. 


Exorclso gd. judgmont-oral Intoraction 


1 


87 


4.29 


0.75 


121. 


Dkoot vortMl intoraction 


2 


86 


4J22 


0.75 


122. 


Adapt to a varloty of comm. situations 


1 


86 


4.30 


0.75 


123. 


Roquost clarification of spokon moss. 


1 


87 


4.34 


0.75 


124. 


Bo awaro of Ustonor's non*vort)al cuos 


1 


85 


4J24 


0.74 


125. 


Bo awaro of ono own non-vortial cuos 


1 


87 


4.31 


0.74 
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CONSTITUENT RESPONDENTS 





PERCENT 
L/N V/E 


Maan 


S.D. 


Vt MTGIACnVE COMMOHICA'nON SKUXS 








126. RMpond to listAfHM^s signs 




4.48 


0.64 


127. NMoh tpoKsn m«ss. to auaisnco m/m 


1 88 


4.40 


0.73 


128. Rofrain from intomiptions 


2 v9 


a.gu 


0 fil 


129. UsiMi to tpoakor and tummariza Idaaa 


1 93 


4.40 


0.64 


130. UstMi to two tpMkars and compara 


1 84 


4.16 


0.70 


131. Uttan to aomaona daacriba situation 


2 69 


3.93 


0.81 


132. Olrtain Information from diff. rasourcaa 


1 87 


4.30 


0.70 


133. Ustan to a diac and avaluata logic 


1 90 


4.41 


0.68 


134. Otiaarva/dasofiba an inddant 


1 82 


4.12 


0.74 
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Primary Teacher Respondents: De mographic Characteristics 
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Number 



Percent 



School Setting 

UrtMn 

Suburban 

Rural 

No Retponse 
Total 

A9e 

Under 2S 

35-44 
^54 
55-64 

65 and over 

No response 
Total 

Years Teaching 
Less than 1 

I - 2 
3-5 
6- 10 

II - 15 
16-20 

21 or more 

No response 
Total 

Sex 

Female 
M9le 

No response 
Total 



622 
783 
820 
38 
2225 

25 
337 
954 
686 
233 
12 
22 
2247 

1 

38 
139 
314 
470 
547 
731 
23 
2246 

1457 
791 
21 
2248 



28.0 
35.2 
36.9 



1.1 
15.0 
42.5 
30.5 
10.4 

0.5 



0.3 
1.7 
6.2 
14.0 
20.9 
24.4 
32.5 



64.8 
35.2 
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Number 



Percent 



HtyMntc Heritage 

Ym 

No 

No response 
Total 

Pace 
Black 

WhKe (non-Hispanic) 
Asian or Pacific Islander 
American Indian or Alaska Native 
Other 

No Response 
Total 

Hi ghest Degree 
Less than a Baciielor's 
Bachelor's 

Bachelor's + additional credits 
Master's or equivalent 
Master's + additional credits 
Doctorate 

No Response 
Total 

Emp loyment status 

Regular Teacher 

Temporary Substitute 

~ermanent Substitute 

Other 
No response 

Total 



42 
2194 

32 
2236 

137 
1978 
47 
9 

35 
30 
2206 

4 

79 
770 
344 
1006 
33 
27 
2236 

2138 
5 
15 
63 
43 

2221 



1.9 
98.1 



6.2 
89.7 
2.1 
0.4 
1.6 



0.2 
3.5 
34.4 
15.4 
45.0 
1.5 



96*3 
0.2 
0.7 
2.8 
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Number Percent 



Gride Level 

ElenMntary 547 
Middl« 

Secondary 897 
No retponM 33 
Total 

Teaching Asstonment 
All or Most School Subjects 513 
Special Education 185 
Arts 

Language Arts and Communication 364 
Mathematics and Computer Science 263 
Physical and Biological Sciences 194 
Social Science 225 
Home Economics 32 
Business and Vocational Education 1 1 o 

Health and Physical Education 78 
Other 

No response 38 
Total 

Average Class SIz? 
1 -9 
10-14 
15-19 
20-24 
25-29 
30 - 34 

35 or greater 54 
No response 3^ 

To^' 2213 



29.4 

653 29.7 
40.8 

2197 

23.5 
8.5 

117 5.4 
16.7 
12.0 
8.9 
10.3 
1.5 
5.0 
3.6 

105 4.8 
38 
2186 

162 7.3 
126 5.7 
239 10.8 
661 29.9 
779 35.2 
192 8.7 
2.4 
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Number Percent 



State 



Alabama 


42 


1.9 


Alaska 


40 


1.8 


Arizona 


39 


1.7 


Arkansas 


45 


2.0 


Caiifomia 


29 


1.3 


Colorado 


56 


2.5 


Connecticut 


49 


2.2 


Delaware 


48 


2.1 


District of Columbia 


31 


1.4 


Rorida 


43 


1.9 


Georgia 


58 


2.6 


Hawaii 


47 


2.1 


Idaho 


50 


2.2 


Illinois 


40 


1.8 


Indiana 


62 


2.8 


Iowa 


51 


2.3 


Kansas 


42 


1.9 


Kentucky 


36 


1.6 


Louisiana 


40 


1.8 


Maine 


48 


2.1 


Maryland 


43 


1.9 


Massachusetts 


34 


1.5 


Michigan 


38 


1.7 


Minnesota 


45 


2.0 


Mississippi 


40 


1.8 


Missouri 


33 


1.5 


Montana 


44 


2.0 


Nebraska 


56 


2.5 


Nevada 


40 


1.8 
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G5 

1 1 0 





Number 


Percent 


N«w Hampthirt 


50 


2.2 


N«w JerMy 


51 




New Mexico 


46 


A 

2«0 


New York 


30 




North Caroline 


44 


*% A 

2«0 


North Dakota 






Ohio 






Oklahoma 


42 


1.9 


Oregon 


44 


A A 
2.0 


Pennsylvania 


52 




Rhode Island 


41 


1«o 


South Carolina 


44 


A A 
2.U 


South Dakota 


47 


A 4 
2«1 


Tennessee 


41 


4 a 
1.0 


Texas 


oa 


4 7 


Utah 


39 




Vermont 


40 


4 Q 


Virginia 


46 


A A 
2.U 


Washington 




1 9 


West Virginia 


^1 


1 ft 


Wisconsin 


52 


2.3 


Wyoming 


59 


2.6 


No response 


23 




Total 


2245 
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Appendix H 
Primary Teacher Respondents: Results of 
Frequency and Mean Analyses 



H1 

112 



PRIMARY TEACHER RESPONDENTS 
N«2269 





L/N* 


V/E* 


MMn 


S.D. 


L nilADWiG 










• • WlVrnllvfV IffWn 


A 


98 


4.77 


0.49 






96 


4.62 


0.60 




2 


64 


4.30 


0.78 


4. naif Hill ftuDOortlnci idMS 


1 


86 


4.35 


0.75 


c flfififTnlTiiB sn flraiuTMnt 


2 


81 


4.20 


0.81 


V* k^WVfl ITIif^V tW^w^f fWVOT 


2 


64 


4.25 


0.78 




4 


70 


3,94 


0.86 




a 


59 


3,73 


0.93 




3 
4# 


74 


4.04 


0.ft4 






71 




0 ft4 


1 1 . R9009niM point of viow 




rO 


4.UO 




12. pofooivo wfun w tnipttoa 










4^ ^^rt^^l-g^ aAASAva^A ^bwMM^h^AA^f 

1 3* HOOOQiwco antnioo oxpfOMOO 


m 
9 


p# 




A aa 
u.oo 




14 


42 




0.92 




2 


87 


4.39 


0.78 




a 






0 aa 




1A 
lU 


ao 




O OA 




7 


fil 


3,77 


0 01 


IV. wvv wOiV 9f UvtlMfil* 


4 
1 


OA 


A ftO 


o ai 

U.w 1 


20. AfTMigo IdOM in rMdlng soloctlon 


9 


72 


4.02 


0.90 


21. MonUfy rotetfonshlps 


3 


76 


4.05 


0.81 


22. Dotormlno impllod rolationthips 


4 


73 


3.97 


0.83 


23. Locali plac« In roadlnQ floction 


5 


76 


4.12 


0.91 


24. Rooognizo difforont lntorpr«tations 


3 


73 


3.99 


0.83 


29* IdomSfy what author assumos 


• 


58 


3.69 


0.89 


26. Rooognizo moaning of word 


2 


84 


4.25 


0.78 



K/H m Of lltllo or no Importanca 
^/E m vory or oxtromoly Important 
* L/N > 20% 
t Moon of iooa than 3.50 



BEST COPY AVAILABLE 
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PRIMARY TEawmIR RESPONDENTS 





t/N 


V/E 


Maan S.O. 


L READIN6 feonfif) 










27. tMsniiliM fiiMnfng of figuration 


5 


70 


3.93 


0.87 


28. UndorslMwIfiifietlon-koy transit 


5 


69 


3.93 


0.88 


29. Comparo/oombino )d#«s 


3 


80 


4.16 


0.81 


30. tdonttfy inoonoUtoncl#s 


4 


74 


4.03 


0.85 


31. Spodfy approprtet* roforonco tourco. 


2 


88 


4.43 


0.77 


32. Undorttand roadlny imttoriais 


5 


71 


3.94 


0.87 


1. WRfnNG 










33. DoacHba an avont/tituation 


1 


91 


4.45 


0.67 


34. DaHnaala tiapa In a procasa 


1 


95 


4.59 


0.61 


35. Support a poaltlon 


1 


84 


4.26 


0.76 


38. Analyzaidaaa 


1 


87 


4.33 


0.72 


37. ProvMa a daar focua 


2 


86 


4.33 


0.76 


38. Produoa/davalop tupp. matartala 


2 


85 


4.28 


0.75 


39. Organlza idaaa 


0 


95 


4.61 


0.59 


40. Uaa vocabulafy appropriatiy 


1 


94 


4.57 


0.63 


41. Praaant Idaaa in writing 


5 


61 


3.78 


0.87 


42. Praaant aHamatlva pointa 


5 


64 


3.82 


0.85 


43. Produea wrMng fraa of arrora 


1 


91 


4.83 


0.70 


44, Raoognlza baalc grammatical arrora 


1 


94 


4.66 


0.62 


4S. Raeognlza affactiva aantanoa ttruotura 


2 


82 


4.22 


0.81 


48. Raoognlza InappropHata languaga 


2 


80 


4.18 


0.81 


47. Ravlaa aanlanoa^ 


1 


93 


4.56 


0.68 


48. Ravlaa paragrapha to oraata 


2 


83 


4.22 


0.77 


49. Roviaa paragrapha to clarify 


2 


84 


4.22 


0.77 



H3 



ii4 



M. MAtHEMAlXS 



50. 


R«oognlz« position of numbors 


51. 


f)ooo9ni20 oquivalont forms 


52. 


So4vO pfOl)iOfllS 


5X 


Uao appcopcMs form of numbor 


54. 


Domonttralt duiraot of counting #'t 


55. 


Intorprot and apply ratio 


56. 


Porform oomputationt 


57. 


Road/lntarprt various graphs 


59. 


Rooognlxs numsricai data 


59. 


Dsmonstrals ability to anaiyzo 


ea 


Intsrprst Moan, Msdian, Modo 




imsrprot Rango, Varianco, S.D. 


62. 


Sslsct soquonco of operations 


1*63. 


Rooognizs rstationships among vaHablos 


64. 


Solvo simpio oquations 


65. 


WHIa squations using variablos 


t 66. 


Raoognizs pattams 


67. 


Usa formutaa for dotarmining langth 


66. 


Uaa vartoua systams of maasuramant 


69. 


Convart units - maasuramant systam 


70. 


krtaf prat togioal connactivaa 


71. 


Uaa daducHvo/kiduetiva raasoning 


72. 


Draw oorract ooncluslons 


73. 


Damonatrata ways to find answars 


74, 


Damonalrata fundamantal algorithma 


^75. 


Uaa SKampIss from history of math 



PRIMARY TEACHER RESPONDENTS 



L/N 


V/E 


Maan 


S.D. 


2 


66 


4.36 


0.79 


3 


62 


4.26 


0.64 


2 


61 


4.20 


0.61 


2 


80 


4.16 


0.61 


6 


71 


4.00 


OM 


4 


73 


4,01 


0.67 


1 


95 


4.67 


0.62 


2 


66 


4.40 


0.76 


5 


69 


3.92 


0.69 


5 


66 


3.65 


037 


11 


51 


X56 


0.95 


21 


36 


3.22 


0.96 


4 


75 


4.04 


0.67 


25 


36 


3.20 


1.07 


6 


75 


4.14 


0.96 


16 


51 


3.51 


1.05 


19 


44 


3.36 


1.04 


17 


52 


XS2 


1.07 


13 


56 


3.64 


1.04 


15 


54 


3.57 


1.06 


11 


57 


3.67 


0.96 


9 


61 


3.75 


0.96 


13 


66 


3.62 


1.01 


6 


73 


3.96 


0.90 


14 


56 


3.66 


1.07 


42 


21 


Z72 


1.04 



H4 
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PRIMARY TEACHER RESPONDENTS 







L/N 


V/E 


Maan S.D. 


M. MATMEMATICS (eonf ^ 










76. 


Expf9M luiy oonc#fy| of tncth 


8 


74 


4.08 


1.00 


77. 


Um Ofllouifltof AS tool 


6 


74 


4.09 


0.96 


7S. 


Um a varMy of imrtorials 


14 


61 


3.76 


1.14 


VL L 












79. 


Roeall Mtuol wording of moosago 


15 


54 


3.62 


1.08 


80. 


Rocail 4 pfiphrno spokon mossago 


2 


88 


445 


0.75 


t1. 


gtltot kifo. in a spokon maiiaga 


1 


87 


4J» 


0.74 


•2. 


Roeognlza a spaaicar's quastion 


1 


95 


4.59 


0.62 


•3. 


Unclafitand icnpllad oont In maasaga 


2 


81 


4.13 


0.76 


•4. 


Undaratand maaning of fij. of spaach 


4 


72 


3.96 


0.85 


85. 


Inltfprat purp. of rhatoHcal davica 


8 


59 


3.70 


0.89 


86. 


Raoognlza ofganix.«tpokan maaaaga 


8 


62 


3.76 


0.91 


87. 


IdanL main Idaa of maitaga diractly 


1 


94 


4.63 


a62 


88. 


Idantk main Idaa of maaa*4nfafabla 


1 


85 


4.27 


0.74 


89. 


idantify a tpaakac'a pufpoaa 


2 


85 


4.31 


a76 


90« 


Raoogniza ttratigth/waaimatt in logic 


3 


73 


3.95 


0.80 


91. 


Palaciiiina facta pcatantad ara ralav. 


2 


77 


4.05 


0.79 


92. 


Datannkia atMlniantJi ata faet/oolnion 


3 


79 


4.12 


0.80 


93. 


Idantify baala of logical argumant 


2 


88 


4.37 


a74 


94. 


Idantffy aaaumpdon of log. argumant 


5 


69 


3.86 


0.83 


96. 


Idantify affaotiva/amotionat content 


6 


65 


3.81 


0.86 


96. 


Fbcua on a cpolcan maaaaga 


7 


70 


3.91 


0.91 


97. 


Undaratand oral tnttnictSona givan 


1 


94 


4.59 


0.63 


96. 


Uaa ctaaa such at pitch 


3 


81 


4.17 


0.81 


99. 


Raoognlza dlalacta of tpokan English 


10 


59 


3.72 


0.97 


tioo. 


Undaratand apolcan Engllah dialacts 


14 


48 


3.47 


0.96 



H5 
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PRIMARY TEACHER RESPONDENTS 





L/N 


V/E 


Maan S.D. 


V. SPEAKMG 










101. Emincteto words 


1 


95 


4.64 


0.60 


102. SpMk in • fluMit manner 




90 


4.44 


0.71 


103. SpMk at nM to b« umtorttood 




90 


4.61 


0.59 


104. SpMk ioudfy to b« h««rd 




97 


4.67 


0JS7 


105. U«# toM of voioa to ooftvay mMMg« 




89 


4.39 


0.71 


106. Plaoo ttrooo appropHatoly 




91 


4.42 


0.69 


107. UMtyooontact 




92 


4JS3 


0.67 


108. Uso grammatical ttructuro oorroctiy 




94 


4419 


0.64 


109. Ad|u«t grammatiGal eomplaxlty 




88 


4.40 


0.76 


1ia Domooatrata baate working vocabulary 




94 


4.54 


0.64 


111. Racognlza maaaaga not undarttood 




96 


4.64 


0.59 


112. Supply aynonym for a word 


1 


93 


4.53 


0.65 


113. Ada|>t vocabulary and styla of lang. 


1 


92 


4.49 


0.66 


114. Ad|uat to unaxpactad changa 




82 


4.19 


0.79 


115. Uaa apokan lang. for variaty of purp. 




92 


4.49 


0.67 


110. Spaak oonciaaly and to ttNo point 




94 


4.53 


0.63 


117. Raad aloud wHh intonation 


1 


86 


4.38 


0.73 


Vt MTEIUCnVECOMMIINK:ATK^ 










lit. GataUalanar'aattantlon 


1 


94 


4.57 


0.63 


110. GIva variMl/non-vart>al faadback 




86 


4.26 


0.76 


120. Exardaa gd. Judgmant^orai Intaractlon 




88 


AM 


0.72 


121. DIraet varballntaraotlon 




83 


4.19 


0.76 


122. Adapt to a variaty of comm. altuatlona 




83 


4.21 


0.75 


123. Raquaat clarification of apokan maaa. 




91 


4.41 


0.69 


124. Ba awara of Uatanar'a non-varbal cuaa 




85 


4.24 


0.74 


125. Ba awara of ona own non-varbal cuaa 




87 


441 


0.73 
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PRIMARY TEACHER RESPONDENTS 





L/N 


V/E 


Iftjan 


S.D. 


VL WfTERACnVE COMMUNiCATIOM SMliS 










126. RMpond to U9lmmt9 signs 


1 


93 


4.48 


0.66 


127. Match spokM m«M. to «udi«fic« i«v«l 


1 


91 


4.41 


0.69 


128. Rsfraift from Inlsmiptlons 


2 


87 


4.31 


0.74 


129. UttM 10 tpoakor and summarizo Idoat 


2 


86 


4.27 


0.74 


130. Uatan to two tpaakart and eompara 


4 


73 


3.98 


0.84 


131. Uston to aomaono doacribo situation 


6 


63 


3.79 


0.87 


132. OMaki infonnatlon from diff. raaourcaa 


2 


79 


4.14 


0.81 


133. Ustan to a disc and avaluata logic 


2 


85 


4.25 


0.76 


134. Obaarva/daaeriba an incldant 


3 


74 


4.00 


0.83 



H7 
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Appendix I 

Primary Teacher Respondents: Me an Ratines hv Race /Ethnicity 
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11 u 







TOTAL 


BLACK 


WHITE 


HISPANIC 








2269 


Ms 


137 


N-1976 


Ns42 




L REAOMG 


Maan 


c n 


iviaan 




Maan 


S.D. 


Moan 




1. 


D«t«rniln« main tdM 


4.77 


0.49 


4.72 


A AA 


4.78 


0.46 


A AA 


A 7A 
U.rU 


Z 


Localt important Idaat 


4.62 


0.60 


4.00 


A O 

0.53 


4.63 


0.59 


A Ofl 

4.30 


A *7A 


3. 


Sdantify aoeurata paraphrataa 


4.30 


0.78 


4.36 


0.72 


4.31 


0.77 


M AA 

4.02 


A 04 


4. 


Datarmlna tupportinQ idaas 


4.35 


0.75 


4.44 


A AJC 

U.D5 


4.35 


0.75 


4.17 


A 

U.93 


5. 


Raeogniza an argumant 


4.20 


0.81 


4.13 


A OO 


4.21 


OM 


4.07 


A 04 


6. 


Datarmina facta/Maat 


4.25 


0.78 


* AA 

4.26 


A OC 

0.65 


4.26 


0.76 


A Ag 

4.09 


A OO 


7. 


IdanUfy ttrangth/waaknaas 


3.94 


0.86 


3.96 


A OA 

039 


3.94 


0.65 


O OO 

3«o3 


A OO 
U.OO 


a. 


Raoogniza tachniquaa 


3.73 


0.93 


3.64 


0.95 


3.73 


0.92 


^ OA 


A OO 
U.OV 


9. 


Racogniza atomanta 


4.04 


0.64 


3.96 


0.6'i 


4.05 


0.63 


3.96 


A OT 

O.o7 


10. 


Idantify logical aaaumptiona 


3.93 


0.84 


3.82 


0.96 


3.94 


0.63 


1 OO 

3«o6 


A fit 


11. 


Raoogniza point of viaw 


4.06 


0.83 


4.05 


0.63 


4,07 


0.83 


4.00 


0.74 


12. 


Parca<¥a what ia impllad 


4.00 


0.63 


3.99 


0.87 


4.00 


0.82 


4.02 


A «VO 

0.75 


13. 


Raoogniza attituda axpraaaad 


3.86 


0.86 


3.85 


0.92 


3.87 


0.64 


3.71 


0.83 


t 14. 


Raoogniza atyfa 


3.o7 


U.9Z 


3.61 


A OO 


3.35 


0.91 


1 AM 
J.^O 




15. 


DisHnguiah facta/opinion 


4.39 


U.r 9 


4.35 


A TO 
U./V 


4.40 


0.77 


A 




le. 


Raoogniza idaaa/tltuationa 


3.7o 


A oa 


3.02 


A ni 
u.ao 


3.78 


0.66 


1 TA 
4 


A Ol 


17 


Palanwina auttior'a purpoaa 


3.76 


0.99 


3.77 


1.00 


3.76 


0.99 


1 AA 
3.D4 


A flfl 


11. 


Undaratand raading talactiona 


3.77 


W.V 1 




A QO 


3.75 


0.91 


^ Til 


A ftC 


19. 


Uaa taMa of oontanta 


4.69 


A 

0.01 


4.63 


0.64 


4.70 


0.60 


A TO 

4.79 


A 

U.42 


20. 


Arranga Idaai In raading aalactlon 


4.02 


A AA 

0.90 


4.04 


A OO 

O.ee 


4.02 


0.90 


4. Ill 


A 07 


21. 


klantify ralationahipa 


4.05 


A 04 
U.Ol 


4.21 


A «VO 

0.76 


4.04 


0.61 


4.12 


A fit 
U.03 


22. 


Dalarmina impilad ralationahipa 


3.97 


0.83 


4.01 


0.83 


3.97 


0.82 


4.10 


0.79 


23. 


Looala plaoa in raading aalactlon 


4.12 


0.91 


4.13 


0.94 


4.13 


0.90 


4.07 


0.97 


24. 


Raoogniza difffarant Intarpratatlona 


3.99 


0.83 


4.16 


0.79 


3.96 


0.63 


3.96 


-84 


25. 


Idantify what author ataumaa 


3.69 


0.89 


3.69 


1.00 


3.69 


0.66 


3.52 


0.71 


26. 


Raoogniza maaning of word 


4JZ5 


0.76 


4.30 


0.62 


4.25 


0.76 


. 4.07 


0.84 


27. 


Dalarmina maaning of figuration 


3.93 


0.67 


4.05 


0.63 


3.92 


047 


4.07 


0.69 


2t. 


Undaratand function-kay transit 


3.93 


0.S8 


4.07 


0.62 


3.91 


OM 


4.12 


0.77 
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ERIC 



L READING (ponro) 


TOTAL 


BLACK 


WHITE 


HISPANIC 


Maan 


S.D. 


Maan 


S.D. 


Makn 


S.D. 


IMaan 


S.D. 


29. Cofnpar«/cofnbin« id«at 


4.16 


0.81 


4.01 


0.87 


4.17 


0.81 


4.t4 


0.87 


30. Identify lnoofi«J»t«ncl«» 


4.03 


0.85 


4.01 


0.82 


4.04 


0.85 


3.90 


0.85 


31. Specify appropriate r«f«ranc« sourca 


4.43 


0.77 


4.41 


0.72 


4.44 


0.76 


4.48 


0.77 


32. Undarttand raading matariaU 


3.94 


0.87 


4.03 


0.77 


3.94 


0.87 


3.74 


0.83 


K. WRITMG 


















33* Daacriba an avant/sltuation 


4.45 


0.67 


4.44 


0.66 


4.41 


0.67 


4U39 


0.59 


34. Dalinaata atapt in a procasa 


4.59 


0.61 


4.49 


0.64 


4.61 


0.61 


4.44 


0.63 


35. Support a poaltion 


4.26 


0.76 


4.23 


0.79 


4.26 


0.76 


4.15 


0.76 


36. Anatyzaldaaa 


4.33 


0.72 


4.38 


0.69 


4.33 


0.72 


4.17 


0.74 


37. Provida a ciaar focua 


4.33 


0.76 


4.27 


0.74 


4.34 


0.76 


4.17 


0.67 


36. Produoa/davalop aupp. matariata 


4J2S 


0.75 


4.32 


0.76 


4.28 


0.75 


4.07 


0.75 


39. Organiza idaaa 


4.61 


0.59 


4.56 


0.58 


4.62 


0.59 


4.61 


0.49 


40. Uaa voeaJsulary appropHatJy 


4.57 


0.63 


4.63 


034 


4.56 


0.63 


4.59 


0.55 


41. Praaant Idaaa In writing 


3.78 


0.87 


3.96 


0.82 


3.76 


0.68 


3.90 


0.70 


42. Praaant attamativa polnta 


3.82 


0.85 


3.93 


0.75 


3.81 


0.86 


3.85 


0.73 


43. Produca writing fraa of arrora 


4.53 


0.70 


4.61 


0.62 


4.53 


0.70 


4.57 


0.59 


44. Racogniza iiatic grammatical arrora 


4.66 


0.62 


4.71 


0.54 


4.66 


0.62 


4.79 


0.47 


45. Racogniza affactfva santanca structura 


4Ja 


0.81 


4.41 


0.68 


4.20 


0.82 


4J29 


0.74 


46. Racogniza Inappropriata languaga 


4.18 


0.81 


4.34 


0.85 


4.18 


0.80 


4.31 


0.68 


47. Ravtoa tantaocaa 


4.56 


0.68 


4.61 


0.62 


4.56 


0.68 


4.64 


0.53 


46. Raviaa paragrapha to craata 


4Ja 


0.77 


4.33 


0.78 


4J22 


0.76 


4.33 


0.75 


49. Ravita paragrapha to cUHfy 


4.22 


0.77 


4.37 


0.80 


4.21 


0.76 


4.39 


0.80 


M. MATYCMAUCS 


















50. Racogniza poaaion of numbara 


4.36 


0.79 


4.32 


0.79 


4.37 


0.79 


4.4C 


0.63 


51. Racogniza aqulvalant forma 


4.26 


0.84 


4.24 


0.77 


4.26 


0.84 


4.40 


0.66 


52. Sdva problama 


4.20 


0.81 


4.27 


0.84 


4.20 


0.81 


4.17 


0 79 
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TOTAL 


BLACK 


WHITE 


HISPANIC 


m 


, MATHEMATICS (rniTd) 






\Am»r% 




Maan 




waan 


S.D. 






Mwm «fjfMvpnfl»v ronn qi nuiuD^f 


4.1 0 


0.01 


4.37 


0.76 


4.17 


0.81 


4.17 


0.88 




54. 


0ofnorurtrsl9 charact. of counting #'s 


4.UU 


0.94 


4.26 


0.86 


3.97 


0.94 


4.31 


0.87 




5S. 


Inttrprot and apply ratio 


4.01 


0.87 


4.07 


0.87 


4.00 


0.87 


4.22 


0.73 




mm 

So* 


Pai fofin oomputatlona 


4.07 


0.82 


4.75 


0.49 


4.66 


0.63 


4.74 


0.50 




57. 


Raad/lnlacprat various graphs 


4.40 


0.78 


4.37 


0.74 


4.41 


0.75 


4.33 


0.85 




5«. 


Rsoognlzo nuwrical data 


3«8Z 


0.89 


4 OA 

3.89 


0.93 


3.91 


0.89 


3.95 


1.03 




59. 


uamofiivais aoiiity to anaiyzs 


1 AC 


0.87 


4 AO 

3.93 


0.91 


3.84 


0.87 


3.86 


0.90 






imsfprac Msan, Madian, Moda 


« mm 

3.5D 


0.97^ 


3.75 


0.93 


3J^ 


0.95 


3.79 


0.87 


t 


81. 


liitsfpfat Ranga, Varianea, S.D. 


4 44 

3.ZZ 


0.96 


3.47 


0.93 


3.19 


0.96 


3.44 


0.90 






Salaot taquanca of oparations 


4.04 


0.87 


4.18 


0.83 


4.04 


087 


4.02 


0.78 


t 




Racognlza ralatiofiships among variablas 


3.2U 


1.07 


3.46 


0.98 


3.17 


1.07 


3.48 


1.11 




04. 


Sofva simpla aquations 


4.14 


0.98 


4.18 


0.94 


4.13 


0.99 


4.41 


0.74 


t 


65. 


WHta aquatlofis using variablas 


Ml 


1.05 


3.73 


0.97 


3.48 


1.05 


3.79 


1.05 


t 


mm 


Raoogniza pattams 


3.36 


1.04 


3.58 


1.05 


3.33 


1.04 


3.50 


0.99 






usa fOfnuiias rof datarmining langtn 


3.52 


1.07 


3.69 


1.08 


3.50 


1.06 


3.57 


1.06 






uaa vanoua systams or maasurainant 




1.04 


3.73 


A A^ 

0.94 


3.63 


1.05 


3.67 


1.00 




ov. 


uonvan umts - inaasuran>aot systatn 


3.57 


4 Aft 


3.67 


0.98 


3.54 


1.06 


3.95 


1.03 




7ft 


niMfj^f at logical connactivas 


9*d7 


A Att 
0.99 


3.77 


0.90 


3.66 


0.98 


386 


1.00 




71. 


llflA ri^AliTttii^ i'lnrliirtliM rA««AMlnM 

WW uOTiiMiHvv/ifKiutviJw raasoning 




u.yo 


3.ao 


A 

0.87 


3.73 


0.96 


3.83 


0.93 




72. 


Draw oorraot conclusions 


A.a2 


1 01 


o./ / 


fi aa 

U.OO 


3.00 


4 A4 
1.01 


3.00 


1.14 




73. 


Damonatrata ways to find answars 


3.96 


0.90 


4.18 


0.81 


3.96 


0.91 


4.10 


0.80 




74. 


Damofiatrata fundamantal algorithms 


3.86 


1.07 


3.99 


0.95 


3.62 


1.08 


4.02 


0.84 


t 


78, 


Usa axamptoa from history of math 


2.72 


1.04 


3.19 


1.06 


2.67 


1.02 


3.12 


0.94 




76. 


Expraaa Icay ooncapt of math 


4.08 


1.00 


4.07 


0.95 


4.07 


1.00 


4.24 


0.76 




77. 


Uaa oateuiator as tool 


4.09 


0.96 


3.93 


0.97 


4.12 


0.95 


3.67 


1.18 




78. 


Usa a variaty of matarials 


3.76 


1.14 


4.06 


1.03 


3.74 


1.15 


3.74 


1.04 
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TOTAL 


BUCK 


WHiTE 


HISPANIC 


Maan 


S.D. 


Maan 


S.D. 


Maan S.D. 


Maan S.D. 


79. 


Raciil MtiMii wording of moMAQo 




1 Aa 




1 no 


3.60 


4 AA 

1.08 


3.57 


A AT 

0.97 


iO. 


Rocall li paraphrsM tpokon motsago 


a.4o 


U./9 


A lit 


A 7ft 
U./O 


A lA 


A 7A 

0.7O 


A ^A 
4.14 


A AA 
U.OO 


•1. 


Saitct Nifo. in « spolcon moMftgo 


A 9Q 






V.t V 


4.28 


0.73 


4.22 


A AA 

0.89 


92. 


Rooognlzo • tpoAkor's quostion 


M MA 

4.5« 


Q.OZ 


4.01 


A A1 


4.59 


0.62 


4.67 


0.48 


•3. 


Undorstand Imptlod oont In motsago 


4.13 


0.7o 


4wC7 


0.72 


4.12 


0.76 


4.07 


A <VA 

0.75 


•4. 


Undorstand moaning of fig. of spooch 


3.96 


A ftC 

u.ao 




A 7ft 


3.95 


0.85 


4.12 


A OA 

0.80 


95. 


Intorprot purp. of rhotoricat davioo 


a./U 


A Mk 

u.av 


1 Ta 


A AA 


3.69 


0.89 


3.83 


0.88 


99, 


Raoognizo organlz.*ftpokan masaaga 


3.70 


Q.vi 




A 


3«73 


0.90 


3.90 


0.76 


•7. 


Idanl main Idaa of mattaga dlractly 




A AO 




A 71 
U./ 1 


4.04 


A A 4 
O.Ol 


A A7 

4.D7 


A A4 

0.93 


88. 


Idant main idaa of maaa-lnfarabia 




A fA 




A 7A 




0.74 


4.38 


A AO 

0.O8 


•9. 


Idantffy a tpaaicar's purpoaa 


A fll 






A 7IC 


4.91 


A <TO 

0.78 


4.30 


A TA 

0.7O 


90. 


Raoognlza atrangth/waaknaaa In logic 




A flA 




A ftA 
U.OO 


3.95 


0.80 


3.93 


0.75 


91. 


Datarmtoa facta praaantad ara ralav. 




A TO 

Q.Tv 


a. lO 


A ft9 


4.04 


0.79 


3.88 


0.78 


92. 


Dalarmkia atatamanta ara fact/opinion 


4.12 


0.OU 


4.22 


A OA 

O.eO 


4.11 


0.80 


4.02 


0.79 




Idanlify liaala of logical argumant 


4U!7 


A '9M 

0.74 


4.30 


A T^ 

0.74 


A *tA 

4.9e 


A T4 

0.74 


A 9A 

4.20 


A TA 

0.70 


94. 


IdaiiUfy aaaumptlon of log. argumant 


•OO 


A Aft 




A ft^l 


3.85 


A 

0.89 


3.O0 


A 04 

O.Ol 


95. 


idantify affaottva/amotionai contant 


1 ai 


0 aa 


ftA 


0 aa 


3.80 


A 


t AA 

3.90 


A TA 

0.7O 


96. 


Foeua on a spokan maaaaga 


o«v 1 


A 01 




A ft.t 


3.92 


0.91 


3.74 


A OA 

0.80 


97. 


Undaratand oral InstructkMia givan 


A ItO 

a.9V 






A AO 


4.9V 


0.83 


4.87 


A M 

0.33 


99. 


Uaa cuaa aueh aa pitch 


A IT 

a. 17 


A Ml 


A IS 
^. IO 


A Aft 


4.17 


A AA 
0.80 


4.21 


A 04 

0.81 


99. 


Raoognlza dlalacta of apokan English 




A or 


J. AA 


A Ol 


3.00 


A tt7 


A A9 

4.02 


A AA 


tioo. 


Undaratand tpokan English dlalacta 


3.47 


A OA 


1 ftA 


A ttft 
U.OO 


3.43 


0.96 


3.71 


0.86 


V. SPEAKMG 


















101. 


Enundata words 


4.64 


0.60 


4.66 


0.54 


4.65 


0.60 


4.67 


0.53 


102. 


Spaak \n a fluant mannar 


4.44 


0.71 


4.57 


0.59 


4.43 


0.72 


4.52 


0.63 


103. 


Spaak at rata to ba undarstood 


4.61 


0.99 


4.61 


0.60 


4.61 


0.59 


4.64 


0.49 


104. 


Spaak loudly to ba haard 


4.67 


0.57 


4.68 


0.54 


4.67 


0.57 


4.67 


0.48 


106. 


Uaa tona of votea to convoy maaaaga 


4.39 


0.71 


4.44 


0.66 


4.39 


0.71 


4.52 


0.67 
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TOTAL 


BLACK 


WHITE 


HISPANIC 


V. SK/yONQ (foonrd) 




S.D. 


Maan 


S.O. 


Maan 


S.D. 


Maan 


S.D. 


106. Pfam ttrm appropriately 




0 ao 


4.41 


0.67 


4.42 


0.68 


4.04 


0.66 


107. Uaa aya contact 




0 fi7 


A Ifi 


0.67 


4.53 


0.67 


4.50 


0.80 


10$. Uaa grammatical ttructura corraetly 






A fi7 




4.59 


0.64 


4.57 


0.63 


100 Adiuat orammatlcal eomolaxltv 


A AA 


0 7a 


A 


0.66 


4.39 


0.77 


4J57 


039 


110. Damonatrala tMMic worWng vocabulary 


A »J 




4.00 




a.sa 


0.64 


4.69 


0.47 


111 Raponnira maataqa not undtntnnrt 


4.o4 


U.OV 


A ai 

4.0 1 




4.64 


0.58 


4.62 


0.62 


112. Suoolv avnonvm for a word 


A d 




a.&4 


0.63 


4.53 


0.65 


4.55 


039 


113. Adapt vocabuiary and atyfa Ov^ tang. 


4.4a 


U.QO 


4»00 




A AM 


0 £7 


4.60 


034 


lia ai<i«>t to unamactad chanoa 


4.1 a 


n TO 




0 70 
v.* V 


418--^ 


0.80 


4.38 


0.62 


IIS. Uaa aBokan lanci. for varlatv of OMrp. 


A AO 

4.4a 


0 ar 




0.62 


0.68 


4.60 


039 


116. Spaafc conciaaty and to tha point 


4.93 


n a^ 


A iC7 


0 sa 


433 


0.63 


4.59 


039 


117 Raad aloud wHh intonation 


4.38 


0.73 


A 


A ai 

U.Dl 


A 1A 


A 79 


a an 


0.77 


VL mTBIACnVE COMMUNiCMION SKUXS 


















iia. fiat a Hitanar^i attantinn 


AST 


0.63 


4.0/ 


A ftA 
V.OU 


A sa 


Q.a3 


4.56 


0.67 


11Q Gh#a vartial/non-varbal faadback 


4.26 


0.70 


4.30 


A T*l 


A 9a 




4.41 


0.77 


190. Exarelaa ocmmI ludomant-oral intaractlon 


4.32 


V«72 


A to 


A Aft 
V.OO 


a 91 


0.73 


4.46 


0.64 


121. DIraot varbal Intaractfon 


A 10 


fi 78 

V./ 9 


4.26 


0.78 


4.18 


0.76 


4.32 


a65 


122. Adapt to a varlaty of comm. $ltuatk>na 


A 91 


0 7S 


a 90 


0.68 


4,20 


0.76 


4.44 


035 


123. naquaat ctoriflcatlon ol apofcan maaa. 


A A1 




4.49 


0.68 


4.40 


0.70 


4.49 


0.60 


124. Ba awara of Uatanar'a no«warbal euaa 


A 9 A 

4.24 


n fA 


4mIO 


A.aa 




0.74 


4.32 


0.69 


125. Ba awara of ona own non-varlMi cuaa 


A 91 
4.«# 1 


n 79 


A AA 


0 A3 


4.29 


0.73 


4.39 


0.70 


126. Raapond to Uatanar'a tigna 


^ Aft 

4.4a 


A aa 


A AfX 
4.4^ 


A aa 


4.48 


0.66 


4.59 


0.55 


127. Match apokan maaa. to audianca taval 


A A1 
4.41 


n AO 
u.ov 


A 90 


0 79 


A an 


0.69 


4.61 


0.49 


12ft. Rafrain from intarruDttona 

a A'Vo f a via vaaap aa^^ii aa<aw» • •w^^*^^'^ 


4*al 


n 7A 

U./4 


A 9a 


A 7a 




0.74 


4.32 


035 


- 129. Uaton to tpaahar and aummariza Idaaa 


4.27 


0.74 


4.28 


A TV 

0.77 


A OA 
4.20 


A fA 


A 11 


0 aa 




3.98 


0.84 


4.07 


0.87 


3.96 


0J» 


4.00 


a77 


131. Uatan to aomaona daacHba altuation 


3.79 


0.87 


3.90 


0.90 


X78 


0.86 


3.83 


035 


132. Obtain Information from dtff. raaourcaa 


4.14 


0.81 


4.13 


0.90 


4.14 


0.80 


4.36 


r.73 


133* Uaton to a diac. and avaluato logic 


4.25 


0.76 


4J» 


a75 


4.25 


0.76 


4.34 


0.73 


134. OlMarva/daaoriba an IncMant 


4.00 


0.83 


4.05 


0.82 


4.00 


-.83 


4.07 


0.75 
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Appendix J 

Primary Teacher Respondents: Mean Ratings bv Sex 



Jl 







TOTAL 
N>22e9 




FEMALE 
N»1457 


MALE 

Na791 


READMG 


MEAN 


S.D. 


MEAN 


S.D.. 


MEAN 


S.D. 


1. 


DMrmkM main ld#a 


4.77 


0.49 


4.80 


0.47 


4.72 


0.52 


2. 


Loom Important Mms 




0 ao 


4.66 


0.56 


4.52 


0.64 


3. 


idontify aoourM pamphraaos 




0.78 


4.37 


0.76 


4.17 


0.60 


4. 


Dotarmkw supporting idaas 






4.44 


0.72 


4.19 


0.77 


5. 


Raoognlza an aryumant 




0.61 


4.21 


0.82 


4.16 


0.80 


e. 


Datarmina lacta/klaaa 




A TA 
U./# 


4.25 


0.80 


4J» 


0.75 


7. 


IdantHy ttrangth/waaknaaa 


^ <kA 




3.94 


0.67 


3.93 


0.65 




Raoognlxa taehniqiiaa 






3.76 


0.94 


3.63 


0.91 


9. 


Raoognlza alamanta 


A 04 




4.09 


0.64 


3.94 


0.83 


10. 


Idantify logical aaaumptlona 




n ftj. 


3.95 


0.85 


3.69 


0.83 


11. 


Raoognlza point of viaw 


4.00 


u.atf 


4.07 


0.64 


4.05 


0.60 


12. 


Parcalva wliat la impliad 


4.0U 




4.09 


0.63 


X63 


0.61 


13- 


Raoognlza attltuda axprMtad 






3.92 


0.85 


X74 


0.85 


14. 


Raoognlza ttyla 




0.92 


3.47 


0.91 


3.18 


0.90 


15. 


Olatlngtilali laota/oplnlon 


4.39 


0.78 


4.41 


0.78 


4.34 


0.80 


16. 


Raoognlza Maaa/aituatlona 


t Ta 




3.66 


0.66 


3.64 


0.85 


17. 


DaHrmlna auttior'a purpoaa 






3.66 


0.99 


X62 


0.96 


It. 


Undarstand raading aalactlona 




0.91 


3.65 


0.91 


X63 


0.66 


19. 


Uaa tabia ol contanta 


A.aft 


0.61 


4.75 


0.55 


4.59 


0.66 


20. 


Arranga Idaaa In raading aalactlon 


4.02 


O.W 


4.11 


0.89 


3.86 


0.90 


21. 


idantify ralatlonahlpa 


4.05 


a6i 


4.13 


0.80 


X91 


0.62 


22. 


Dalarmlna Impliad ralatlonahipa 


3.97 


0.63 


4.05 


0.61 


3.64 


0.84 


23. 


Locata plaoa in raading salaction 


4.12 


0.91 


4.25 


0.86 


X69 


0.94 


24. 


Raoognlza dHfarant intarpratatkma 


3.99 


0J3 


4.07 


0.62 


3.86 


0.62 


25. 


Idantify what author aaaumat 


3.69 


0.69 


3.60 


0.69 


3.50 


0.64 


26. 


Raoognlza moaning of word 


4J25 


0.76 


4.34 


0.76 


4.09 


0.62 



tMMMt Of IMS thwi 3^ for on* or moro rotpomiont uibgroup* 

J2 



ERIC 



126 



L READMQ (ooiir^ 


TOTAL 




FEiyiALE 


UALE 




S.D. 


UBAH 


S.O. 


l/IEAN 


S.D. 


27. 


Dctormkw mining of fi^urction 


3.93 


0.87 


4.03 


0.86 


3.76 


0.85 


28. 


Understand functk>n-k«y transit 


3.93 


0.88 


4.02 


0.87 


3.76 


0.87 


29. 


Compm/oomblne idMs 


4.18 


0.81 


4.22 


0.81 


4.05 


0.81 


3a 


Identify kioontist*nci«s 


4.03 


0.85 


4.08 


0.85 


3.95 


0.83 


31. 


Specify appropriate r afaranca sourca 


4.43 


0.77 


4.53 


0.71 


4.27 


0.83 


32. 


Undaratand reading matadala 


3.94 


0.87 


4.07 


0.84 


3.71 


0.87 


I. WRfTViQ 














33. 


Daaeriba an avant/altuatk>n 


4.45 


0.67 


4.51 


0.65 


4.34 


0.68 


34. 


Dallnaala atapa in a procaaa 


4.59 


0.61 


4.65 


0.59 


4.48 


0.64 


3S. 


Support a potHlon 


4JM 


0.76 


4.31 


0.75 


4.16 


0.76 


3«. 


Anaiyza idc^ 


4.33 


0.72 


4.37 


0.72 


4JW 


a7i 


37. 


Provida a ciaar focua 


4.33 


0.76 


4.39 


0.75 


4.22 


a77 


38. 


Produoa/davaiop aupp. matariaia 


4.28 


0.75 


4.34 


0.74 


4.15 


0.76 


39. 


Organize idaat 


4.81 


0.59 


4.66 


0.56 


44(3 


0.63 


4a 


Uaa vocabulary approprlatiy 


4.57 


0.63 


4.64 


0.59 


4.44 


0.67 


41. 


Present kSeas in wrttlng 


3.78 


0.87 


3.84 


0.87 


3.66 


0.87 


42. 


Present altamatlva points 


3.82 


0.85 


3.89 


0.85 


3.69 


0.85 


43. 


Produce writing free of errors 


4.53 


0.70 


4.63 


0.65 


4.34 


0.75 


44. 


Recognize baalc gramnurtScal errors 


\M 


0.62 


4.77 


0.53 


4.45 


0.71 


45. 


Recognize effecUve sentence structure 


4.22 


0.81 


4.29 


0.81 


4.08 


a8i 


46. 


Recognize inappropriate language 


4.18 


0.81 


4.29 


0.78 


3.98 


0.81 


47. 


Raviae sanlancea 


4JS8 


0.68 


4.67 


0.60 


4.35 


a75 


48. 


Reviae paragrapha to create 


4.22 


0.77 


4.31 


a74 


4.07 


0.79 


49. 


Revlae paragraplia to clarify 


4J22 


0.77 


4.29 


0.76 


4.09 


0.78 



J3 

1 p^v 







TOTAL 




FEMALE 


MALE 


MATHEMATICS 






MEAN 


S.D. 


MEAN 


S.D. 


SO. 


R«oo9niz« fXwHIon of numb«rs 




ft TO 


4.41 


a77 


4.26 


04a 


SI. 


^moognUm oqulval^fit forms 


4.20 


A MA. 


4.30 


0.62 


4.10 


OM 


S2. 


Solvo pcoWoms 


a^SKi 




4.26 


a76 


4.06 


OM 


S3. 


U«o approprialo form of munbor 


4.18 


A Ai 

0.6 1 


4.26 


0.70 


4.02 


0J1 


S4. 


OomoiMlral* char, of counting #'s 


4.00 


0.04 


4.00 


0.04 


3.64 


0.01 


S5. 


inlMrpr«t and apply ratio 


4.01 


0*67 


4.01 


0.66 


4.01 


0.66 


56, 


Pof form oomputationa 


6.07 


u.o« 


4.70 


0.60 


4.61 


0.65 


57. 


Raad/fctUcprt varteua grapha 


6.ao 


A 7a 


4.46 


a73 


4.30 


aT9 


St. 


Raoogniza numartoal data 


3.92 


A ao 
U.OV 


3.02 


0.02 


3.00 


034 


S9. 


Damonatrala abttity to analyza 


3.65 


A MY 

0.07 


3.66 


0.67 


3.70 


0.66 


t 60. 


Intarprat Maan^ Madlan, Moda 


9*ao 


A OK 
U.¥0 


3.60 


ao6 


X40 


0.04 


t «1. 


Inlarprat Ranga, Varianoa, S.O. 




A oe 


3.27 


0.07 


3.13 


0.04 


62. 


St<aot aaqwanoa of oparattona 


4.04 


A ft7 

u.ar 


4.07 


0.86 


3.06 


034 


t 63. 


Raoognlza raMonshipa among varlablaa 




1 A7 


3.15 


1.06 


3.27 


1.06 


64. 


Solva aknpla aquatkMia 


A ^A 
4.14 


A oa 


4.16 


0.00 


4.06 


0.05 


66. 


VWta aquattena using variabias 


«>.a 1 


1 M 


3.53 


1.06 


X46 


1.02 


t 66. 


Raoogntoa patlama 


9.90 


1 AA 


3.36 


1.06 


3.30 


131 


67. 


Uaa formuiaa for dalsrmining langth 




i AT 


3.51 


1.06 


3.55 


1.05 


66. 


Uaa vartoua systams of maaiuramant 


^ tLA 

9.04 




3.64 


1.06 


3.66 


1.02 


60. 


Convart unita - maasuramant systam 


3.57 


1J)6 


3.56 


1.07 


3.57 


1.03 


70. 


Intarprat iogicat oonnaothfaa 


3.67 


ao6 


3.73 


0.07 


335 


0.07 


71. 


Uaa daductiva/lnduetiva raaaoning 


3.75 


0.06 


3.77 


0.07 


X60 


0.04 


72. 


Draw oorract oondusions 


3.62 


1.01 


3.63 


1.02 


X60 


aoo 


73. 


Damonatrala ways to find answars 


3.06 


0.00 


4.03 


0.00 


3.60 


0.66 


t 74. 


Damonatrata fundamantai aigorithmt 


3.66 


1.07 


X76 


1.06 


3.47 


1.07 


t 75- 


Uaa axsmpias from history of math 


2.72 


1.04 


2.73 


1.06 


2.60 


1.00 



ERIC 
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«L MUmeiATICS (oonfd) 


TOTAL 




FEMALE 


MALE 


lyiEAN 


S.O. 


MEAN 


S.O. 


MEAN 


S.D. 


7$. ExpfMA kiy concept of math 


4.08 


1.00 


4.16 


0.98 


3.92 


1.01 


77. Um ealcuMof m tool 


4.09 


0.96 


4.12 


0.95 


4.04 


0.97 


f 7S. Uto a vMrMy of matMlaU 


3.7$ 


1.14 


3.91 


1.15 


3.48 


1.08 


IV. LESTENMQ 














79. Roeall atftuai wording of mossago 


3.82 


1.08 


X65 


1.10 


3.56 


1.03 


80. RooaM paraphraaa tpokan motaaga 


4.35 


0.75 


4.42 


0.74 


4.24 


0.76 


81. ^aiact info. In a spokan maaaaga 


4.29 


a74 


4M 


0.71 


4.14 


0.76 


tk9 R^MMiniT* M ftiMAk#r's ouastlon 


439 


0.62 


4.67 


0.59 


4.46 


0.64 


83. Undaratand impiiad cont in maaaaga 


4.13 


0.76 


4.21 


0.75 


3.99 


0.75 


84. Undaratand maaning of fig. of tpaach 


3.96 


0.85 


4.03 


0.85 


3.84 


0.84 


as. interarat ouro. of rhatoricat davtea 


3.70 


0.69 


3.74 


0.90 


3.62 


036 


aa. Raeoonlza oroaniz.-aDOkan maaaaga 


3.76 


0.91 


3.82 


0.94 


3.65 


0.83 


87. Want main kSaa of mattaga diractiy 


4.63 


0.62 


4.70 


0.58 


4.52 


0.68 


88. idant main Idaa of maaa-infarabia 


4.27 


0.74 


4.35 


0.73 


4.12 


0.76 


89. IdantSfy a •paaicar'a purpoaa 


4.31 


0.76 


4.36 


0.76 


4.23 


0.77 


90. Raoognlza atrangth/waaknaaa In iogic 


3.95 


0.80 


3.95 


0Jt2 


3.95 


0.76 


91. Datarmina facta praaantad ara ralav. 


4.05 


0.79 


4.06 


0JB2 


4.03 


0.74 


92. Dalarmkia atatamattu ara fact/opinion 


4.12 


0.80 


4.16 


0.81 


4.04 


0.79 


93. Idantify iMMla of logical argumant 


4.37 


0.74 


4.42 


0.72 


4.28 


0.76 


aa. uiaiiiifw aaaumotlon of loo. araumant 


3.86 


0.83 


X87 


a84 


3.82 


0.83 


95. IdantHy affacttva/amotJonal contant 


3.81 


0.86 


3.85 


0.86 


3.72 


0.87 


96. Focua on a apokan maaaaga 


X91 


0.91 


3.98 


0.90 


3.77 


0.91 


97. Undaratand oral Inttructiona givan 


4.59 


0.63 


4.65 


0.60 


4.49 


0.68 


98. Uaa cuaa aiich aa pitch 


4.17 


0.81 


4J23 


0.81 


4.08 


0.80 


99. Raoognlza dialacta of apokan English 


3.72 


0.97 


3.83 


0.94 


331 


0.98 


tlOa Undaratand apokan English dialaeta 


3.47 


0.96 


3.57 


0.95 


3.29 


0.96 
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V. SPEMONG 


TOTAL 




FEMALE 


MALE 


MEAN 


S.D. 


MEAN 


S.D. 


MEAN 


S.O. 


101. 


Enundato words 


4.64 


0.50 


4.72 


0.54 


4.50 


0.66 


102. 




4.44 


0.71 


4.52 


047 


4.29 


a76 


103. 


SimmIc rate to hA iinfif tfMifl 


4.01 


059 


4.66 


04U( 


4.49 


a64 


104* 


SiMAk i***iHiM |A Ka hMrd 


4.S7 


0.57 


4.72 


OM 


4.57 


0.61 






4.39 


0.71 


4.46 


QM 


4.25 


0.74 


106. 




4.42 


0.60 


4.46 


0.68 


4.31 


0.71 


107 


Uaa mm ^outset 


4^ 


0.57 


4.61 


0.63 


4.39 


0.72 


108. 




4.59 


0.64 


4.72 


0JS3 


4^ 


0.75 


1M 
1 w. 




4.40 


a76 


4.49 


0.73 


4.23 


0.79 


110. 


DMMMWInM basic working vocabulary 


4.54 


0.64 


4.63 


0.59 


4.36 


0.69 


111. 


Raoognin maataga not undarstood 


4.54 


050 


4.70 


0.55 


4.53 


0.63 


112. 


Supply synonym for a word 


4.53 


0*65 


4.63 


0.61 


4.34 


0.67 


113. 


Adapt vocabulary and styla ol tang. 


4.49 


0.66 


4.57 


0.63 


4.35 


0.71 


114. 


Adiuat to unaxpactad ehair^ 


4.19 


0.79 


4.30 


0.75 


4.00 


0.62 


115. 


Usa spokan iang. for variety of purp. 


4.49 


0.67 


4.56 


0.63 


4.33 


0.72 


lie. 




4.53 


0.63 


44S9 


0.59 


4.42 


0.67 


117. 


Raad aloud wWi intonation 


4.3S 


0.73 


4.50 


0.66 


4.17 


0.78 
















lie. 


Gat a liatonar's attantkm 


4,57 


0.63 


4.64 


0.59 


4.45 


0.69 


119. 


GIva varfaal/non-yart>al faadback 


4^ 


0.76 


4.35 


0.72 


4.08 


0.79 


12a 


Exardaa gd. Judgmant-oral intaractkm 


4.32 


0.72 


4.41 


0.70 


4.17 


0.73 


121. 


DIraot vartMri Inlar action 


4.19 


0.76 


4jrr 


0.74 


4.03 


0.78 


122. 


Adapt to a variaty of comm. situations 


4^1 


0.75 


4.29 


0.73 


4.07 


0.77 


123. 


Raquaat dariflcatlon of spokan mass. 


4.41 


0.69 


4.46 


0.67 


4.31 


0.71 


124. 


Ba awara of listanar's non-^^artoai cuas 


4^4 


0.74 


4^ 


0.69 


4.05 


0.77 


125. 


Ba awara of ona own non*varbal cuaa 


4.31 


0.73 


4.40 


0.69 


4.13 


0.77 



J6 



VL INTaUtfniVECOMaiUNICAllONSiaU^ 


TOTAL 




FEMALE 


MALE 


MEAN 


S.D. 


MEAN 


S.D. 


MEAN 


S.D. 


126. 


Respond to llslMm't signs 


4.4a 


a66 


4.56 


0.62 


4J)3 


0.69 


127. 


Match spoksn msss. to sudkmos Isvsl 


4.41 


0.89 


4.48 


0.66 


4.27 


0.72 


128. 


Rsfrsin from intamtptlons 


4.31 


0.74 


4.36 


0.73 


4.21 


0.75 


129. 


Ustsn to spMksr and summariza Maas 


4.27 


0.74 


4.33 


0.72 


4.15 


0.75 


130. 


Ustan to t0O spaakars and oompara 


3.98 


0.84 


4.02 


0.85 


3.89 


0.81 


131. 


Uslai« 19 somaona daacHba situation 


3.79 


0.87 


3.82 


0.88 


3.72 


0.84 


132. 


Otrtakt infonnatlon from diff. rasoMrcas 


4.14 


0.81 


4.20 


0.81 


4.04 


0.80 


133. 


Ustan to a disc and avaiuala iogio 


4.25 


0.76 


4.27 


0.78 


4.22 


0.73 


134. 


Obaarva/daaeriba an incidant 


4.00 


0.83 


4.04 


0.83 


3.93 


0.83 
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Appendix K 

Prim5»w Teacher Rf.>;pondents ; M^pn Ratines bv Teaching Exp$ri$nge. 



K1 



_ N 

a M 
M * 


o 
«) 

1 


i i i i i i i i 1 i i i S i s S i i i i 


• 




S i S 5 i i i i 1 i s i 1 1 i s 1 i i i 


• it 

• * 


c 

1 


! 5 n n 5 s i n s ? ^ : 5 n n 


at 


d 

CO 

e 

3 

3 


i i i i s 5 i i i i 1 i i i 2 s i i i i 
n 3 3 ; 2 ? s s m S i 5 s J S 2 ! 


? f 


i 


i 1 i i ? s i i i i i s i i i i ? n i 


1 


5 s n 3 m J s J S 2 i S S s n S 


VI z 




1 i g 5 g i i s i 1 i S s i S s 1 1 i i 


1 


5 S 3 3 n s H n 5 s i n J s 5 2 ! 






1 i i S 1 s 1 i i 1 i i 2 i M i i i i 


1 


5 n n n s n n m s s 5 n 



5 



c 

I 



i3 6 4 S| 

6 6 o o 



5 & S S S ^ 3 

6 6 d 6 o o o 



6 O 



^ 5 



o 



dddddooooooo 



o o o o 



o o 



o 

CO 



I 



g g ^ ^ 

d d d o o 



s 8 s ^ 

d d d o o o 



8 ^ 

o o 



^ • Q K ^ 9 n 
K K « lO « • «0 

d d d d o o o 



o 

CO 



c 

2 



5^SSS;:8^S888 

doddoooooooo 



o o 



d d o o o o o 



8SSSSSS8SS 



VI 



G 

I 



ddddoooooooo 



3&S8?S^SSS 



o o 



o o 



i 



I 



^ ? Si S 8 



& 8 S 3 i:: & 



&5SiSISiSSS&3 



o o o 



o o o 



d d d o o o 



SS:SS3^SSI?^SS 



* « 8 S S 



^ «> M 



ID • M 

a K • 

^ ei M 



CO 



§2 



a 

1 



t 
I 



n til 



I 

I 
s 
I 

5 



1 1 



O O 



• 

2 



112 
111 



9 



I 



2 6 

^ I 
I ^ 



a • 

2 & 



3 

2 



3 



I 

O 



I 
2 



CP 



I 

S 3 8 si 8 



1 ^ 



3 "2 
« • 
5 o 



S 

3 



? 

s 

I 

J 

I 



e 

1 

> 

1 



at 



CO 



ERIC 



M 

Al 



o 

CO 



I 



VI 



i 



^ ^ § 

o o o 

^ ^ 



5 3 S 

6 6 e 
? 5 § 



666eeeeeeeeee^«- 



g S 8 S ^ 3 



sssssssje 

oooooooo 



2 & S S S 8 S 



w ^ ^ V ^ ^ « ♦ ♦ ♦ ♦ 



S 8 8 3 s le s 



s{ ? s ^ ^ ^ 



3S}!S8SS885SS;S8 



S ^ S 5 3 8 



8 s a 



8 a; 3 i: ^ ^ 

d o d o o o 



^ ^ 8 s ^ 



6 6 6 6 

5 8 I? 



s 



8^ « 01 cji » 3» 
• w o w 

n C9 C9 C9 ^ e) « 



8 8 ^ 1^ 8 

60000 



a( ^ s 1; 8 



8^:;88SS3SSS8838 



0.70 


3 
<» 


s 


6 


0 


0.77 


0.77 


0.79 


S 

6 


• 

6 


• 

6 


6 


• 

6 


0.62 


0.76 


0.69 


m 

6 


0.05 


8 

6 


6 


e 


8 

6 


8 


8 






8 


a 


SI 


8 


8 






8 


0 


0 


S 


M 




S 











.0 

TO 




O 

E 

i I 

3 



f 

i 

t i 
I I 

I - 



1 

1 1 
u 



o 

CO 



II 



a 



5 



e 



iHtl 

i * I I 1 

Ml 

i S M 



11 



^ ff ^ 

Si s s 



ERIC 



CO 





§ 


in n m m ! s s 


i S g i s s n 


Ai 


1 


n n 2 s 5 3 s m u 


3 § 2 1 ; 3 a 5 


• 


d 




i S 3 s i 


• 


1 


2 S 5 3 2 S S 5 5 S n 5 B 

ffi ff% o o O *^ * ♦ * * . 


3.54 
4.33 
4.30 
4.60 
4.14 
4.01 
3.70 
3.75 


• 


5 




! s i 1 S i 1 i 


■ 


1 


2 S 2 s 3 s n 3 i n 5 s 


3.61 

4.37 

4.27 

4.60 

4.13 

3.04 

3.66 

3.72 


• 


s 


U § 1 5 1 i i m i 1 ? 


! 3 i 3 i 3 3 s 


s 

• 


1 


3 S g S m S n a ; I s 


3.66 
4.30 
4.34 
4.67 
4.16 
4.00 
3.73 
3.70 


5. 


s 


1 1 ? 1 1 1 i i S i ? i 1 S 


5 3 ^ 3 i i 3 3 


VI 


1 


n 3 1 s n s s 1 a n 5 


3.65 
4.45 
4.33 
4.62 
4.13 
3.66 
3.70 
3.73 




i 


? 5 B 5 ! i S s i § ? S i 2 


? S 3 1 3 3 3 s 




1 


3 2 3 i g g a i 3 3 S S 5 5 


3.62 
4.39 
4.20 
4.50 
4.13 
3.06 
3.70 
3.76 



2 



..J 



>- 

O 

o 

CO 

EJJ 



f 

3 



t 4- 



1 
§ 



8. 
I 



I ! i 



s 



r 



s 



> 
S 



Ol o 



I 
s 

2 



I 8 
1 ^ 

^ 1 

1 

n 
1 1 



« 5 



m 

E 

o 

I 



s 
i 

E 



« 



2 

E 
"5 



8 

• _ 

It 



I 

« 1 2 

I i I 

lO « N 

r* r* K 



I i 



1 1 

1 1 1 

cc oc ^ 

^ 3 S 3 



« S 



i 
2 

"5. 

II 



5 
I 

1 
s 

f o 



f 



3 

3 



? 

c 

I 

? i 
3 1 

I ^ 

I s 



c 



m 

94 

IE 

y 

ee 



S 8 S 



ERIC 



• 


d 

CO 

c 

1 


4.62 0.65 
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4.12 0.70 
4.36 0.76 
3.90 0.63 
3.79 0.67 
3.69 0.69 
4.57 0.66 
4.15 0.76 
3.66 0.96 
3.44 0.96 

4.62 0.63 
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4.65 0.56 
4.35 0.72 
4.41 0.70 
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4.64 0.62 
4.27 0.77 
4.30 0.60 
3.96 0.61 
4.06 0.79 
4.11 0.61 
4.36 0.72 
3.64 0.63 
3.62 0.65 
3.66 0.92 

4.61 0.62 
4.13 0.67 
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4.36 0.75 
3.81 0.85 
3.78 0.87 

3.93 0.94 
4.59 0.63 
4.16 0.81 
3.72 0.96 
3.50 0.98 
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4.44 0.69 
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4.59 0.61 
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3.78 0.93 
3.54 0.90 
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4.42 0.68 
3.93 0.79 
3.79 0.84 
4.05 0.87 
4.58 0.59 
4.36 0.71 
3.86 0.96 
3.66 0.93 

4.69 0.55 
4.60 0.59 
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4.72 0.52 
4.51 0.64 
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4.69 0.53 
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3.96 0.80 
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4.12 0.80 
4.37 0.74 
3.86 0.83 
3.81 0.86 
3.91 0.91 
4.59 0.63 
4.18 0.81 
3.72 0.97 
3.47 0.96 

4.64 0.60 
4.44 0.71 
4.61 0.59 
4.67 0.97 
4.39 0.71 
4.42 0.69 
4.53 0.67 
4.59 0.64 
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Appendix L 

Primary Teacher Respondents: Mea n Ratings bv Subject Taught 
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Appendix M 

Primary Teacher Respondents: Mean Ratings by School Setting 
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50. Damonalrala ability to analyza 


3.65 


0.67 


3.90 


0.67 


333 


0.67 


332 


037 


t ea Intwprat Maan, Madian, Moda 


XSB 


0.95 


X63 


0.94 


34S6 


0.96 


X49 


a95 


t 61. imarprac Ranga, Varianea, S.a 


3.22 


0.96 


3.26 


a96 


X19 


0.95 


X19 


0.95 


62. Salact asquanca of oparationa 


4.04 


0.67 


4.08 


0.90 


X99 


0.66 


4.06 


a64 


t 63. Raoognixa ralationahlpa among variablaa 


3*20 


1.07 


3.23 


1.08 


3.16 


1.08 


3.20 


1.05 


64. Sofva aimpla aquations 


4.14 


a96 


4.12 


1.00 


4.13 


0.98 


4.16 


a96 


t 65. Wrtia aquations using variaMas 


3.51 


1.05 


3.54 


1.07 


330 


1.04 


X48 


1.03 


t 66. Raoognlza patlama 


3.36 


1.04 


3.38 


1.09 


337 


0.99 


332 


1.05 


t 67. Usa formulaa for datarmlning langth 


3.52 


1.07 


3.50 


14)9 


X40 


1.04 


336 


1.07 


66. Uaa varloua aystama of maaauramant 


3.64 


1.04 


3.67 


1.08 


336 


1.02 


X67 


1.05 


69. Convart untta - maasuramant systam 


XS7 


14)6 


X64 


1.07 


330 


1.06 


336 


1.04 


70. Marprat logical oonnaotlvas 


3.67 


0.96 


X76 


0.99 


X65 


0.97 


X60 


0.97 


71. Usa daduetiva/lnductlva raaaoning 


3.75 


0.96 


3.62 


a97 


X74 


0.94 


X69 


0.96 


72. Draw corraet oondualona 


X62 


1.01 


X69 


1.01 


X61 


0.99 


337 


131 


73. Damonatrata waya to find answara 


3.06 


0.90 


4.05 


0.90 


X95 


0.90 


X94 


0.89 


74. Damonatrala fUndamantal algorithm 


3.66 


14J7 


3.76 


1.06 


334 


1.07 


X66 


1.07 


t 75. Uaa axamplaa from history of math 


2.72 


1.04 


233 


1.07 


2.60 


1.01 


2.73 


1.04 


76. Expraaa kay oonoapt of malh 


AM 


1.00 


4.13 


1.01 


4.04 


0.99 


4.06 


0.99 


77. Usa calculator as tool 


4.00 


0.96 


4.06 


0.96 


4.16 


0.92 


4.05 


037 


76. Usa a varMy of matarials 


3.76 


1.14 


3.83 


1.14 


X70 


1.17 


X74 


1.11 



BEST COPY AVAILABLE 



M4 



ERIC 



1Gb 





TOTAL 


URBAN 


SUBURBAN 


RURAL 


Itf USTENMIG 


Mvan 




Maan 


S.D. 


Maan 


S.O. 


Maan S.D. 


TO Oa«»a1I ^BfuAl mordlfMi of mMMCM 




1 Aa 


a.a7 


1.06 


3.63 


1.06 


t mA 


1.10 


Oil. nWWi • ftmtm^nnmmm my%*9\mtt (•■■■■■v ■ 


4.99 


V./9 


A 37 


0.74 


4.41 


0.70 


A 9A 


070 

V./ w 




4.29 


A '9M 
V.74 


A tA 
4.9U 


ft 77 




0.70 


4.24 


0.74 








4.62 


0.63 


4.65 


0.55 


432 


037 


lift. llivlMfttAnd ImDilod conL In flMSMQO 


4.19 




A 17 


0.79 


4.16 


0.74 


A n7 


0.76 


1 liift^atanri mo^nlrtfl of fICL of IfidTh 


4 AA ' 

9.90 


A aK 


3.oa 




3.97 


0.95 


t OK 






3.70 


A AA 

0.99 


9.70 


A a7 
v.a/ 




0.01 


t aa 


0.69 




9.70 


A Q1 




093 


3.79 


0.90 


3.69 


0.90 


III ■tit main Ifiaa a# tafia rilfTlltf 


4.09 


A a9 


A at 


0.64 


4.67 


OM 


A.SO 


0.65 


Ml III a tit maUri Af rnaaa Inff ahto 


4.27 


v.74 


4mmC 


A 7a 

V.#0 


a.90 


0.74 


A^l 


0.73 


89. lUMiury a tpMMr* purpo»» 


4.31 


A TA 

U.70 


A tK 
4.90 


A.77 


4.33 


0.76 


A 99 


0.76 




3.95 


A SA 

0.911 


A f%9 
4.uZ 


ft ao 


3.09 


0.79 


3.97 


0.91 




4.05 


A *VO 

O.Tv 


4.1^ 


0 70 

V./ V 


4.07 


0.77 


X96 


0.90 


Q9 n^AimlnA •talAinfiti aro fM^t/ooiflion 


4.12 


v.aw 


4.22 


0.77 


4.12 


0.92 


4.03 


0.60 




4.37 


0.74 


4.42 


0.73 


4.40 


a72 




0.76 


94. ktofitify MMimptlOft of log. argufiMnt 


4 aa 


A a^ 


t OA 


0.93 


3.99 


0*60 


X75 


0.65 




4 A4 
931 


A aa 


t.09 


o.aa 


390 


0.64 


X71 


0.99 


cui siamia aa a aiwikMi ma taafi# 


9.91 




3 aa 


0J7 


3.91 


0.91 


335 


0.92 


Q7 t liiflMrif and oral tnatructionft alvofl 


^ KO 


A at 




062 


4.61 


0.61 


43"^ 


0.66 


oa 1 IttA Mi^A auaIi Aa Aiteii 


4.1 / 




4JK> 


0.93 


4.20 


0.79 


A 19 


0 91 


oo Rattwinlza iHaiTili of sookon EiKinsh 


3.72 


0.97 


3.92 


A oa 
u.vo 


t aa 


ft 00 


X65 


0.95 


y lOv, UnQaf lianiii •fioiivn ui^iwi uiaiw^m 


3.47 


0.96 


X59 


0.97 


3.40 


a99 


X44 


0.93 


V. SPEMONG 


















101. EmmcMtwordt 


4.64 


0.60 


4.67 


a60 


4.66 


0.57 


4.61 


0.62 


102. Spoak ki ft fluont mannor 


4.44 


0.71 


4.49 


0.69 


4.45 


0.69 


439 


0.74 


103. Spaak at rata to ba undarstood 


4.61 


04S9 


4.63 


0.59 


4.63 


036 


439 


0.61 


104. Spaak loudly to ba haard 


4.67 


037 


4.70 


0.55 


4.70 


0.55 


4.63 


0.59 


10S. Uaalonaof votoalooonvay masaaga 


4.39 


0.71 


4.45 


0.71 


4.39 


0.70 


436 


0.71 



MS 

.166 







TOTAL 


URBAN 


SUBURBAN 


RURAL 


V. 8PEMCMG 


wMan 


S.D. 


Maan S.D. 


Maan 


S.D. 


Maan 


S.D. 


106. 


PteM ttriMS approprtateiy 


4.42 


0.69 


4.47 


0.67 


4.43 


a68 


438 


0.72 


107. 


Um #y« ocntaot 


44(3 


0.67 


4.56 


0.65 


4.55 


0.66 


4.49 


0.70 


106. 


Um graiMMtieal ttruetura oonfotly 


4.59 


0.64 


4.68 


0.58 


4.58 


0.63 


434 


039 


100. 


Ac^uct ynwimtoil ootnpl<Mity 


4.40 


0.76 


4.42 


0.79 


4.44 


0.70 


434 


0.79 


110. 


OMMtitlral* iMSto woridng vooabuiary 


4.54 


0.64 


4.58 


0.61 


4.56 


0.61 


4.49 


037 


111. 


Raoognfapa m— lay not undartood 


4.64 


0.59 


4.68 


035 


4.66 


037 


439 


031 


112. 


Supply •ynofiym for a word 


4.53 


0.65 


4.59 


0.62 


435 


0.63 


4.46 


0.69 


113. 


Adapt vooabulary and atylo ol lang. 


4.49 


a66 


4.52 


0.64 


432 


0.65 


4.44 


0.70 


114. 


Adjuat to unoxpactad changa 


4.19 


0.79 


4^ 


0.78 


4.18 


0.79 


4.15 


030 


115. 


Uaa apokan tang, for varialy of purp. 


4.49 


0.67 


442 


0.66 


432 


0.66 


4.42 


0.70 


116. 


Spaak oonctaaiy and to lha point 


4.53 


0.63 


4.56 


0.62 


432 


0.63 


431 


0.64 


117. 


Raad aloud wHh Intonation 


4.38 


0.73 


4.44 


0.70 


435 


0.75 


436 


0.74 




















116. 


Oat a ttalanar'a atlantfon 


AST 


0.63 


4.62 


0.61 


437 


0.62 


434 


0.66 


119. 


Ghfa vartMa/non-vartMl foadback 


4.26 


0.76 


4.31 


0.76 


4jat4 


0.77 


4.22 


0.75 


120. 


Exarofoa good Judgmant-oral intaraotfon 


4.32 


0.72 


4.37 


0.72 


432 


0.71 


4.29 


0.73 


121* 


DIraot varlMil Inlaractlon 


4.19 


0.76 


4.22 


0.76 


4.17 


0.76 


4.17 


0.78 


122. 


Adapt to a varlaty off oomm. altuationa 


4JI1 


0.75 


4.28 


0.73 


4.19 


0.75 


4.18 


0.76 


123. 


Raquaat oiartflcatlon of apokan maaa. 


4.41 


0.M 


4.45 


0.67 


4.42 


0.69 


4.38 


0.71 


124. 


Ba cwara of Ualanar'a noo-vart>al ctiaa 


4J24 


0.74 


4.31 


0.72 


4.23 


0.72 


4.20 


0.76 


125. 


Ba awara of ona own nof>-varl)al cuaa 


4.31 


0.73 


4J37 


0.71 


4.29 


0.72 


4.27 


0.75 


126. 


Raapond to Hatonar'a aigna 


4.46 


QM 


4.48 


0.66 


4.49 


0.66 


4.46 


0.65 


127. 


Matoli apolcan maaa. to audlanoa laval 


4.41 


0.69 


4.43 


0.70 


4.43 


0.66 


436 


0.71 


126. 


Rafrain fMni kitarfupUona 


4.31 


0.74 


4.35 


0.72 


4.27 


0.75 


430 


0.74 


129. 


Uaton to apaakar and aummariza Maaa 


4.27 


0.74 


4.27 


0.75 


4.26 


0.72 


4.26 


0.75 


130. 


Uaton to two apaakara and compara 


2M 


0J4 


AM 


0.86 


3.96 


031 


3.94 


034 



M6 



VL linERACnVE COMMUNlCA'nON SKILLS 

131. UttMlo tom^oiM <l#tcHb« situation 

132. Obtain Infonnatlon from diff. r«soure«s 

133. U««Mi to a diac. and avaluata logic 

134. OtMarya/doseriba an Inckknt 



TOTAL 


URBAN 


SUBURBAN 


RURAL 




S.D. 


MMn S.O. 


mmn S.O. 


Moan S.D. 


3.79 


0.87 


XB5 


0.89 


3.78 


0J3 


3.73 


0.88 


4.14 


0.81 


4.21 


0.82 


4.15 


0.80 


4.09 


0.81 


4.25 


0.78 


4.29 


0.74 


4.27 


0.75 


4.20 


0.78 


4.00 


0.83 


4.05 


0.85 


4.02 


0.81 


3.95 


C.84 



ERIC 



M7 

168 



Appendix N 

Primaiv Teacher Respondents: Mean Ratings h v School Level 



ERIC 



N1 







TOTAL 


ELEMEN. 


IMIDDLE 


SECOND. 






Ns2269 


N» 


647 


N»653 


N-897 




REAMiG 


IMaan 


S.D. 


IMaan S.D. 


Maan 


D.U. 


IMaan 


S.D. 


1. 


U^mvnkm main M«a 


4.77 


0.49 


4.77 


0.50 


4.77 


0.51 


4.77 


0.47 


2. 


Loeato important klMS 


4.62 


0.60 


4.62 


0.60 


4.63 


0.60 


4.62 


0419 


3. 


Idantify aoourata paraphraaaa 


4.30 


0.78 


4.30 


0.78 


4.30 


0.80 


4.31 


0.77 


4. 


Dalarmina supporting idaaa 


4.35 


0.75 


4.46 


0.60 


4.34 


0.78 


4.28 


0.76 


5. 


Racogniza an argumant 


4.20 


0.81 


4.07 


0.87 


4u{3 


0.81 


4.27 


a77 


ft. 


Datarmina faeta/tdaaa 


4.25 


0.78 


4.14 


0.84 


4.27 


0.75 


4.32 


0.76 


7. 


Idantlfy ttrangth/waaknaaa 


3.94 


0.86 


3.83 


0.90 


3.98 


0.83 


3.99 


0.85 


«. 


Raoognlza tachniquaa 


3.73 


0.93 


3.76 


0.94 


3.80 


0.89 


X66 


0.94 


9. 


Raoogntea aiamanta 


4.04 


0.84 


4.03 


0.85 


4.06 


0.83 


4.03 


0.84 


ia 


Idantlfy logical aasumptiona 


3.93 


0.84 


3.85 


0.86 


3.92 


0.83 


3.99 


0.84 


11. 


Raoognlza point of viaw 


4.06 


0.83 


4.05 


0.82 


4.08 


0.82 


4.05 


0.84 


12. 


Parcalva what la Impllad 


4.00 


0.83 


4.05 


0.82 


4.01 


0.82 


X96 


0.84 


13. 


Raoognlza attHuda axpraaaad 


3.86 


0.86 


3.85 


0.85 


3.88 


0.84 


3.85 


0.87 


14. 


Raoognlza ttyia 


3.37 


0.92 


3.52 


0.89 


3.39 


0.90 


3.25 


0.93 


15. 


DIatingulah facta/oplnion 


4.39 


0.78 


4.39 


0.79 


4.40 


0.78 


4.38 


0.78 


19. 


Raoognlza klaaa/sltuatlona 


3.78 


0.86 


3.91 


0.87 


X78 


0.85 


3.70 


0.86 


17. 


Dalarmlna author's purpoaa 


3.78 


0.99 


3.89 


0.98 


X77 


0.97 


3.71 


1.01 


IS. 


Umlarstand raading salactiona 


3.77 


0.91 


368 


0.88 


3.79 


0.91 


3.69 


0.91 


19. 


Uaa tabia of contants 


4.69 


0.61 


4.71 


0J57 


4.70 


0.62 


4.67 


0.61 


20. 


Arranga Waas in raading salaction 


4.02 


0.90 


4.04 


0.89 


4.06 


0.89 


X98 


0.91 


21. 


Idantlfy ralatlonahips 


4.05 


0411 


4.19 


0.75 


4.03 


0.83 


3.98 


0.83 


22. 


Datarmina Impllad ralatlonahips 


3.97 


0.83 


3.99 


0.81 


4.00 


0.84 


X94 


0.84 


23. 


Looala placa In raading salacdon 


4.12 


0.91 


4.20 


0.87 


4.19 


0.91 


4.04 


0.90 


24. 


Raoognlza diffarant intarpratatlons 


3.99 


0.83 


4.02 


0.83 


4.00 


0.82 


3.97 


0.82 


25. 


Idantlfy what author aaaumaa 


3.69 


0.89 


3.68 


0.91 


3.73 


0.88 


3.67 


0.87 


26. 


Raoognlza maaning of word 


4^5 


0.78 


4.36 


0.74 


4J» 


0.77 


4.15 


0411 


27. 


Dalarmlna maaning of figuration 


3.93 


0.87 


4.10 


0.84 


3.92 


0.85 


3.82 


0.88 


2t. 


UndaratMid funotkm-kay transit 


3.93 


0.88 


3.97 


0.87 


3.96 


0.85 


3.88 


0.89 



tMcan of Im* than 3.90 for on* or mor* r««pond«nt subgroups 

N2 



BEST COPY AVAILABLE 



ERIC li'U 



L REAOMG foomftf) 


TOTAL 


ELEIMEN. 


MIIDDLE 


SECOND. 


lyiaan 


S.D. 


Maan 


S.D. 


lAaan 


S.D. 


lAaan 


S.D. 


29. Compara/combin* IdMS 


4.16 


a6i 


4.12 


0J2 


4.19 


0.81 


4.15 


0.81 


30. Idmitify IneofMtotmiM 


4.03 


065 


3.96 


0.89 


4.04 


0.63 


4.06 


0.81 


31. Specify appropriate r«f«r#ne« sourc« 


4.43 


0.77 


4.52 


0.70 


4.46 


0.73 


4.35 


OMi 


32. Undarstand raading matarialt 


3.94 


0.67 


4.02 


0.84 


3.94 


0.65 


3J6 


0.89 




















33. Daaeriba an avam/sttuatkNi 


4.45 


0.67 


4.49 


0.67 


4.46 


0.65 


4.40 


0.68 


34. Oalinaata tiapa in a procass 


439 


0.61 


4.56 


0.61 


4.61 


0.61 


4.59 


0.62 


35. Support a poaitlon 


4.26 


0.76 


4J21 


0.79 


4.26 


0.74 


4.27 


0.75 


36. Analyzaldaaa 


4.33 


0.72 


4.27 


0.74 


435 


0.73 


4.36 


0.69 


37. Provkto a daar focua 


4.33 


0.76 


4.23 


OM 


4.37 


0.73 


4.37 


0.75 


3S* ProdMoa/davatop tupp. malariata 


4.26 


0.75 


4J24 


0.79 


4.31 


a72 


4.28 


0.75 


39. Organiza Idaaa 


4.61 


a59 


4.62 


0.60 


4.62 


0.60 


4.60 


0.58 


40. Uaa vof^abuiary appropriatiy 


4.57 


0.63 


4.59 


0.61 


4.59 


aoi 


4.53 


0.64 


41. Pratant Idaaa in writing 


3.76 


0.87 


3.92 


0.65 


3.61 


0.63 


3.66 


0.90 


42. Praaant altamativa polnta 


3.62 


0.85 


3.86 


0.83 


3,87 


0.64 


3.76 


0.88 


43. Produoa writing fraa of arrors 


4.53 


0.70 


4.61 


0.66 


4.54 


0.69 


4.47 


0.72 


44. Racognlza basic grammaticai arrora 


4.66 


0.62 


4.78 


0.52 


4.66 


0.60 


4.58 


0.66 


49. Raoogniza affactlva aantanca tiructura 


4.22 


0.61 


4.29 


OM 


4.21 


0.78 


4.17 


0.61 


46. Raoogntza Inappropriata tanguaga 


4.18 


0J1 


4J22 


0.83 


4.20 


0.79 


4.14 


0.80 


47. Raviaa aanlaneaa 


4.56 


0.66 


4.66 


0.61 


4.55 


0.66 


4.49 


0.71 


46. Raviaa paragrapiia to craata 


4.22 


0.77 


4.27 


OM 


4.27 


0.73 


4.15 


0.77 


49. Raviaa paragraphs to ciarify 


4.22 


0.77 


4J24 


0.77 


4.25 


0.76 


4.18 


0.76 


WL MA1HEMMT1CS 


















5a Raoogniza position of numbara 


4.36 


0.79 


4.45 


0.75 


4.37 


0.77 


4M 


0.84 


51. Raoogniza aquivalant forms 


4.26 


0.64 


4.32 


0.79 


4.28 


0.63 


4J21 


0.87 


52. Soiva probiams 


4.20 


0.81 


4.28 


0.77 


4.24 


0.80 


4.13 


0.83 



N3 

171 



MATHEMATICS (oonf^ 


TOTAL 


ELEMEN. 


MIDDLE 


SECOND. 


Mean 


S.D. 


Mean S.D. 


Mean 


S.D. 


Mean 


S.D. 


53. Um approprlato fonn of number 


4.16 


0J1 


4.26 


0.76 


4.16 


0.63 


4.11 


0.62 


54. DMnofi«tral» eharact of counting #'t 


4.00 


a94 


4.16 


0.64 


4.00 


0.93 


3J6 


0.98 


55. Inl»rpr«t and appty ratio 


4.01 


0.67 


3.96 


0.66 


4.03 


0.86 


4.04 


0.86 


56. Parform computations 


4.67 


a62 


4,75 


0.54 


4.66 


a6i 


4.60 


0.67 


57. Raad/kHMrprat vaHoua graphs 


4.40 


0.76 


4.51 


a69 


4.46 


a71 


4.26 


0.82 


59. Raoognfaa mimarteai data 


3.92 


a60 


3.65 


0.90 


3.95 


0.87 


3.94 


0.90 


59. Dsmonstrata abWty to analyze 


3.65 


0.67 


3.62 


0.67 


3.67 


0.68 


3.85 


0.86 


ea Intafprat Mean, Median, Mods 


3.56 


a95 


3.53 


0.95 


3.60 


a94 


%S5 


0.95 


t 61. kitarpfot Ranga, Variance, S.D. 


X22 


0.96 


3.26 


0.95 


3.22 


0.98 


3.19 


0.95 


62. Sa<act aaquanca of oparatfona 


4.04 


0.67 


4.21 


0.79 


4.03 


0.89 


X92 


0.89 


t 63. Raoognlza relationships among variat>laa 


3.20 


1.07 


3.10 


1.04 




1.05 


3.26 


1.10 


64. Soiva slmpia aquatlona 


4.14 


0.96 


4.35 


0.86 


4.15 


0.94 


X99 


1.04 


t 65. WHIa aquationa using variabiaa 


3.51 


1.05 


3.58 


1.03 


3.55 


1.02 


X42 


1.07 


t 66. Racognlza pattama 


3.36 


1.04 


3US3 


1.02 


3.31 


1.01 


3.27 


1.06 


t 67. Uaa formulaa for datarmining length 


3.52 


1.07 


3.63 


1.01 


3.57 


1.08 


X41 


1.09 


66. Uae varloua systama of meaaurement 


X64 


1.04 


3.67 


1.05 


3.66 


1.01 


X60 


1.07 


69. Convert units - measurement system 


3.57 


1.06 


3.57 


1.04 


3.59 


1.08 


X56 


1.06 


7a interpret logical connectives 


3.67 


a96 


3.72 


0.99 


3.66 


0.97 


X62 


0.98 


71. Usa deductive/Inductive reaaoning 


3.75 


a96 


3.71 


0,97 


3.75 


0.93 


X76 


0.97 


72. Draw correct conclusions 


3.62 


1.01 


3.55 


1.01 


3.65 


0.98 


X64 


1.03 


73. Demonstrale ways to find snswers 


3.96 


0.90 


4.09 


0.87 


4.02 


0.85 


3.86 


0.93 


t 74. Demonalrata fundamental algorithma 


3.66 


1.07 


3.96 


0.97 


3.67 


1.06 


X42 


1.09 


t 75. Uae axamplea from history of math 


Z72 


1.04 


2M 


1.04 


Z76 


1.05 


2.63 


1.02 


76. Expraea Icey concept of matii 


4.06 


1.00 


AM 


0.67 


4.10 


0.94 


3.87 


1.06 


77. Uae calculator as tool 


4.09 


0.96 


4.02 


0.97 


4.14 


0.93 


4.11 


0.96 


t 76. Use a variety of matariaia 


3.76 


1.14 


4*33 


0.90 


3.76 


1.09 


3.36 


1.16 




USTSMG 


TOTAL 


ELEMEN. 


MIDDLE 


SECOND. 


MUan 


S.O. 


Maan 


S.D. 


Maan 


S.D. 


Maan 


S.D. 


79. R«e«M actual wording of m«Mag« 


3.82 


1.08 


3.63 


1.08 


3.61 


1.08 


X62 


1.07 


8a Roeall 4 parapliraaa spokan maasaga 


4.35 


0.75 


4.35 


0.79 


AM 


0.73 


4M 


0.72 


81. Salaot Info, in a apokan maaaaga 


4.29 


0.74 


4.30 


a77 


4.27 


0.73 


4.29 


0.71 


82. Racognixa a apaakar'a quaatton 


4.59 


0.82 


4.60 


0.66 


4.60 


0.60 


4JS9 


0.59 


83. Undaratand implM com In maaaaga 


4.13 


0.78 


4.08 


a80 


4.16 


0.74 


4.15 


0.74 


84. Undaratand maaning of fig. of tpaach 


3.98 


0.85 


4.01 


0.83 


3.98 


o;85 


3.91 


0.86 


85. IntarpraC purp* cf rhatorical davica 


3.70 


0.89 


3.68 


0.90 


3.75 


0.88 


3.67 


0.89 


88. Raoogniza organir-apokan maaaaga 


3.78 


0.91 


3.79 


a94 


3.78 


0.89 


3.73 


0.89 


87. Idant main idaa of maaaaga^dlractly 


4.63 


0.82 


4.63 


0.65 


4.65 


0.60 


4.63 


0.62 


88. Idant main Idaa of maaa-infarabia 


4.27 


0.74 


4.31 


a77 


4.24 


a74 


4.26 


0.73 


89. IdamHy a apaakar'a purpoaa 


4.31 


a78 


4.33 


a78 


4.34 


a76 


4J29 


0.76 


90. Racognlza ttrangth/waaknaaa in logic 


3.95 


030 


3.87 


0.85 


3.95 


0.77 


4.01 


0.79 


91. OatarmkM facta praaantad ara ralav. 


4.05 


0.79 


3.97 


0.84 


4.06 


0.78 


4.10 


0.76 


92. Dalarmlna statamanta ara fact/opinion 


4.12 


0.80 


4.04 


0.86 


4.11 


0.80 


4.18 


0.75 


93. Manttfy baaia of logical argumant 


4.37 


0.74 


4.36 


a77 


4.42 


0.71 


445 


0.74 


94. Mantify aaaumptlon of log. argumant 


3.86 


0.83 


3.78 


0.87 


3.86 


0.81 


X91 


0.82 


95. Mantify affactiva/amotlonai contant 


3.81 


0.88 


3.77 


0.88 


3.82 


0.85 


3.82 


0.86 


98. Focua on a apokan maaaaga 


3.91 


aoi 


3.91 


0.95 


3.91 


0.87 


X91 


0.91 


97. Undaratand oral inatructiona gtvan 


4.59 


0.83 


4.59 


0.64 


4.61 


a62 


4.58 


0.63 


98. Uaa otiaa aMcli aa pHch 


4.17 


OM 


4.20 


0J1 


4.19 


0.80 


4.16 


0.80 


99. Racognlza dialacta of apokan Engliah 


3.72 


0.97 


3.81 


0.92 


3.71 


a97 


X66 


0.99 


1 100. Undaratand apokan Engliah dialacta 


3.47 


0.96 


3.56 


0.95 


3.50 


a94 


3.39 


0.98 


V. SPEAKMG 


















101. Enundala worda 


4.84 


0.60 


4.68 


0.59 


4.65 


0.58 


4.62 


0.61 


102. Spaak In a fluant mannar 


4.44 


a71 


4.50 


0.69 


4.43 


0.71 


4.41 


0.72 


103. Spaak at rata lobaundaratood 


4.81 


0.59 


4.64 


0.58 


4.62 


0.59 


4.58 


0.60 


104. Spaak lOMdIy to ba haard 


4.87 


0.57 


4.68 


0.59 


4.69 


0.56 


4.66 


0.56 


105. Uaa tona of vdoa to convay maaaaga 


4.39 


0.71 


4.42 


0.72 


4.44 


0.65 


4.35 


0.73 



N5 



V. SPEAKMQ (oo«r^ 
10$. Plao« ttrvM appropriately 
107. Uaa ay« contact 
lot. Usa grammatical atructura corraetfy 

109. Adjut gram ma tical comp*axrty 

110. Damonatrala iMalo woridfig vocabulary 

111. Racognixa maaaaga not undarafeood 

112. Supply aynofiym for a word 

113. Adapt vocabulary and ttyla oflang. 

114. Ad|uatto unc Kp act a d changa 

115. Uaa apokan lang. for variety of purp. 

116. Spaak oondaaly and to tha point 

117. Raad aloud wHh Intonation 

VL MTEMCmECOililUNICAT^ 
IIS. Gat a Halanar's attention 

119. Glva vartMl/nofwarbai faadback 

120. Exardaa good ]udgmant-oral Intaraction 

121. DIractvartoal intaraction 

122. Adapttoa variaty of comm. ahuatlona 

123. Raquaat dariflcaHon of apokan maaa. 

124. Ba awara of Kalanar'a n on* v art>al cuaa 

125. Ba awara of ona own non-varbal cuaa 

126. Raapond to ttatanar'a signa 

127. Match apokan maaa. 10 audtanca laval 
126. Rafrain from Intamiptlona 

129. Uatan to apaakar and aummariza Maaa 

130. Uatan to two apaakara and compara 



TOTAL 


ELEMEN. 


MIDDLE 


SECOND. 


Maan 


&D. 


Maan 


S.D. 


Maan S.D. 


Maan 


S.D. 


4.42 


0.69 


4.43 


a7i 


4.48 


0.65 


4.38 


a7i 


4.53 


0.67 


4.55 


0.66 


4.57 


0.62 


4.50 


0.70 


4.59 


0.64 


4.70 


0.58 


4.59 


0.63 


44(1 


0.67 


4.40 


0.76 


4.43 


a76 


4.45 


a70 


4.35 


0.78 


4.54 


0.64 


4.59 


0.64 


4.56 


0.62 


44X) 


0.65 


4.64 


0JS9 


4,65 


a6i 


4.64 


0.58 


4.64 


058 


AJS3 


a65 


4.56 


a64 


AM 


0.62 


44K) 


0.66 


4.49 


0.66 


4J» 


0.65 


4.55 


0.62 


4.41 


a70 


4.19 


0.79 


4.24 


0.76 


4.25 


0.76 


4.13 


0.82 


4.49 


0.67 


4.52 


0.66 


4411 


oj$r 


4.46 


a68 


4.53 


0.63 


4.54 


0.62 


434 


0.65 


44S2 


a62 


4.36 


0.73 


4.52 


0.66 


4.40 


0.68 


4.27 


0.78 


4.57 


0.63 


4.64 


0.61 


4.59 


0.61 


44S2 


a65 


4.26 


0.76 


4.30 


a75 


4.26 


0.74 


4J22 


a77 


4.32 


0.72 


4.34 


0.75 


AJ32 


0.70 


4.32 


0.71 


4.19 


0.76 


4.21 


0.80 


4.19 


a77 


4.16 


a73 


4.21 


0.75 


4.24 


0.75 


4.23 


a74 


4.18 


a75 


4.41 


0.60 


4.41 


0.71 


4.40 


a70 


4.43 


- a67 


4.24 


a74 


4.27 


0.73 


4.25 


a74 


4J22 


a74 


4U)1 


0.73 


4.33 


0.72 


4.31 


0.72 


4.28 


0.74 


4.46 


0.66 


4.50 


0.66 


4.48 


0.67 


4.48 


0.65 


4.41 


a69 


4.45 


0.70 


4.42 


0.67 


4.37 


0.69 


4.31 


0.74 


4.31 


a77 


4.31 


0.73 


4.31 


0.72 


4.27 


0.74 


4.27 


a76 


4.27 


0.73 


4.27 


0.73 


3.96 


0.64 


3.93 


0.66 


X99 


0.82 


4.00 


0.81 
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ERIC 



i 



74 





TOTAL 


ELEMEN. 


MIDDLE 


SECOND. 


131. UstMi tQ tomtOfMi <iMcHb« situation 




S.O. 


Maan 


S.D. 


Maan S.D. 


Maan S.D. 




OJU 


3.69 


0.94 


3.84 


0.84 


3.81 0.82 


132. Ototaki Infonnatloii from cUff. rMOurc«t 


4.14 


0J1 


4.07 


0J6 


4.19 


0.80 


4.17 0.78 


133. LMm to a dtac and «valu«l9 logic 


4.25 


0.76 


4.21 


0J2 


4.25 


0.78 


4.29 0.72 


134. Obaarva/daacrlba an incMant 


4.00 


0.83 


3.96 


0.67 


4.07 


0.81 


3.98 0.82 
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Appendix O 

<^lf ,t.< Within H q ^h nf thP. Fniir NASDTF,C GgOgr?^phic RggionS 
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17 J, 



ERIC 



FAR WEST 



Alaska 

Arizona 

California 

Colorado 

Hawaii 

Idaho 

Montana 



New Mexico 
Nevada 
Oregon 
Utah 

Washington 
Wyoming 



SOUTHERN 



Alabama 

Arkansas 

Florida 

Georgia 

Kentucky 

Louisiana 

Mississippi 



North Carolina 
South Carolina 
Tennessee 
Texas 
Virginia 
West Virginia 



CENTRAL 



Illinois 

Indiana 

Iowa 

Kansas 

Michigan 

Minnesota 

Missouri 



Nebraska 
North Dakota 
Ohio 

Oklahoma 
South Dakota 
Wisconsin 



NORTHEAST 



Connecticut 
Delaware 

District of Columbia 

Maine 

Maryland 

Massachusetts 



New Hampshire 
New Jersey 
New York 
Pennsylvania 
Rhode Island 
Vermont 



02 



Appendix P 

Primary Teacher Respondents: Me an Ratings bv Region 



FRir 



P1 



J. 7b 



z 



o 



s 



to 

N 

z 



i 2 



M 
Z 



CO o 

5 « 



dddddoooooo 



8 
w 


4.71 


4.42 


4.50 




4.40 


4.07 


& 


4.14 


4.07 


4.19 


4.13 


3.96 


3.90 


4.45 


3 

ci 


0.53 


0.63 


0.82 


0.77 


s 

d 


d 
d 


N 

m 

d 


OM 


S 

d 


& 

d 


m 

d 


S 

d 


S 

d 


0.93 


s 

d 


0.87 



dddddddd 



K O 9 
• K p 



8 CM CO Q 
01 «D 9 



dddddoooooo*^*^ 



dddddooo 



S8Si:s?3S:SSSSS5 

ddddddoooooooo 



• M <^ ^ 01 S 
o» o c; o» 

d d ^ d o o 



M o 9 ^ 

N N « 0( 

CO n « CO 



• 9 P !P S 

* ^ 1^ 



iSSSSSSSSSS 



WWWVW^eoeo^co^^eoeo* 



8 S S S S 

d d o o o 

R 5 3 g 

CO CO CO W « 



CM 

a. 



J? 

3 



s 




1 1 1 



2 i 



1 • ? -s 



•i^ -3 5 • 

r rf rl 

flC flC 5 flC Q. 



1 1 

O m 



I 

c 
a 
o 

III 

If 

flc 2 flc 
V n d 



a 



1 



I I 

3 Z> 



i I s 

m 
m 



m 

4 



8 

i 
s 

CO 

c 



o 
c 

S 



i 

o 
z 



o 
in 



c 
m 



flC 
UJ 



o 

CO 



m 

I 



Z 

s 

UJ 



o 

0) 



Q 

CO 



o 

0) 



e 

8 
s 



Q 

i6 



m 



<j6o<i6doooooo 



oddoodoooo 



SS5SS3SSSS!;S| 

ddodbddooooo 



dddddooooo 



ddddddoooooo 



8 8 !: ^ » S 

« W W ^ c) W « 



« K t: 
o «r o 



dddddddooo 



odbooooooooo 



SSkkkiJSSSS 

dddddooooo 



d 


8 

d 


0.91 


m 

d 


01 

m 

d 


0.78 


K 

m 

d 


0.88 


s 

d 


0.85 


O 


0.87 


0.87 


s 

o 


<o 
d 


4.0S 


$ 

n 


M 


s 


01 


M 
CM 


« 

01 




w 


q 


« 


s 


to 


s 





^ « 5 S 



• CM 

N CD 



f>> M • 

^ W W W C^ C^ 



CO 

a. 



LU 
CD 

3 



O. 
O 

o 

CO 
LU 

CQ 




3 



I 
2 



a, 
m 

c 



■ 

1 



1 

a, 

3 
CO 

i4 



I 

N 

>% 

I 



m 




I 



> 
C 

c 

s 

s 

a. 



o 



?! ? ^ f: ? S S 

o o o o o o o 



SI i 



tt 3 



5 a 



i i i i I I i 1 i 1 1 s i i 1 
5 3 n 1 I ! : i S ^ 5 i 3 5 



m 
o 



boooooo 



S m 3 ; ; 



1 S i i 1 i S i s i S i 1 n 



o 

CO 



o 

CO 



e 

8 
s 



^ 3 C ? S S S 

0666600 

S ; n S 3 s 



i S i S I I i e 1 i i s i S i 

! n 5 5 5 5 j 3 3 1 n s s 



0) 



oi 6600000 



n n 3 ; ; 



g i 1 i s i i S i ! i i i 2 i 
3 S 5 ! s i n i s S n i I 



i 



(o 6600000 



3 ! S i n 2 



s i i i i § i i S i n m 



UJ 
CO 

3 



o 

UJ 

CXI 




NORTHEAST 


d 

CO 

e 
• 

1 


3.53 1.03 
3.30 1.03 

3.54 1.01 
3.54 1.02 

3.60 1.03 
3.75 0.06 

3.64 0.91 
3.66 0.97 

4.02 0.67 
3.66 1.04 
2.70 1.00 
4.04 0.99 
4.06 0.96 

3.61 1.14 

3.65 1.06 
4.41 0.72 
4.37 0.66 
4.65 0.56 
4.19 0.72 

4.03 0.64 
3.60 0.63 
3.69 0.67 


CENTRAL 


U 

oi 

e 
m 

1 


3.42 1.03 
3.26 1.04 
3.46 1.06 

3.56 1.05 
3.50 1.04 
3.59 0.96 

3.65 0.97 
3.53 1.05 
3.90 0.94 
3.56 1.09 
2.63 1.06 
4.01 1.03 
4.13 0.95 

3.66 1.17 

3.62 1.06 
4.32 0.76 
4.23 0.76 
4.53 0.66 
4.05 0.61 
3.90 0.66 
3.66 0.92 
3.71 0.92 


SOUTHERN 


d 


3.61 1.05 
3.45 1.06 
3.63 1.10 
3.75 1.06 
3.66 1.07 
3.77 0.97 

3.61 0.97 
3.69 1.01 
4.01 0.90 
3.79 1.03 
2.90 1.09 
4.16 0.97 
4.06 0.99 

3.62 1.14 

3.66 1.06 
4.31 0.60 
4.30 0.70 
4.62 0.60 
4.16 0.73 
4.04 0.64 
3.72 0.69 
3.77 0.90 


FAR WEST 


d 


3.46 1.07 
3.31 1.03 
3.46 1.06 
3.64 1.04 
3.53 1.07 
3.59 1.00 
3.69 0.97 
3.56 0.99 
3.99 0.66 
3.62 1.11 
2.67 1.00 
4.06 1.00 
4.09 0.94 
3.75 1.12 

3.55 1.09 
4.37 0.71 
4.25 0.75 
4.59 0.61 
4.12 0.76 
3.90 0.65 
3.63 0.91 
3.69 0.92 


TOTAL 1 


d 

CO 
e 

1 


3.51 1.05 
3.36 1.04 

3.52 1.07 

3.65 1.04 
3.57 1.06 
3.67 0.96 

3.75 0.96 
3.62 1.01 
3.96 0.90 

3.66 1.07 
2.72 1.04 
4.06 1.00 
4.09 0.96 

3.76 1.14 

3.62 1.06 
4.35 0.75 
4.29 0.74 
4.59 0.62 
4.13 0.76 
3.96 0.65 
3.70 0.69 
3.76 0.91 




NORTHEAST 


d 

c 

1 


4.M 0.09 
4.33 0.74 
4.3a 0.71 
4.10 0.76 
4.17 0.73 
4.20 0.74 
4.49 0.70 
3.09 0.79 
3.90 0.64 
3.96 0.66 
4.64 0.62 
4.16 0.62 
3.73 0.96 
3.90 0.97 

4.67 0.97 
4.46 0.69 
4.63 0.96 
4.69 0.94 
4.40 0.70 
4.43 0.66 
4.92 0.69 
4.62 0.64 


CENTRAL 


d 

e 

1 


4.63 0.63 
4.23 0.76 
4.30 0.79 
3.67 0.61 
3.96 0.60 
4.03 0.63 
4.30 0.76 
3.76 0.69 
3.76 0.69 
3.67 0.91 
4.99 0.67 
4.22 0.76 

3.66 0.96 
3.36 0.99 

4.61 0.62 

4.36 0.79 
4.99 0.62 

4.67 0.99 

4.37 0.72 
4.42 0.71 
4.93 0.66 
4.93 0.66 


SOUTHERN 1 


d 

e 

8 
s 


4.64 0.61 
4.29 0.71 
4.33 0.76 
3.92 0.79 
4.03 0.61 
4.13 0.79 
4.39 0.72 
3.62 0.62 
3.79 0.66 

3.92 0.69 
4.64 0.97 
4.16 0.62 
3.64 0.94 
3.64 0.94 

4.70 0.99 

4.93 0.69 
4.69 0.96 
4.69 0.99 
4.44 0.67 
4.44 0.67 
4.96 0.64 

4.71 0.53 


FAR WEST 1 


d 
(6 

c 

1 


4.61 0.60 
4.29 0.74 
4.26 0.79 
3.93 0.62 
4.09 0.61 

4.12 0.63 
4.37 0.74 
3.69 0.69 
3.76 0.67 

3.66 0.99 
4.99 0.64 

4.13 0.62 

3.67 1.00 
3.36 0.97 

4.61 0.64 
4.39 0.74 
4.96 0.61 
4.64 0.96 

4.38 0.72 

4.39 0.72 
4.93 0.69 
4.92 0.66 
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Appendix Q 

Su pplementarv Teacher R ftf;pnndents: Results of 
Frequency ar H M^^^ Analyses 



Q1 



SUPPUEMEffTARY TEACHER RESPONDENTS 
N»236 





L/N* 


V/E* 


lyiaan 


S.D. 


READMG 










1. PsHrmkK main M— 


0 


95 


4.87 


0.58 


Z Loo«to important IdMs 


0 


94 


AM 


0.82 


3* Idanttfy accurate paraphrasM 


2 


85 


4.28 


0.78 


4. Datarmina aupporting Idaaa 


2 


85 


4.34 


0.80 


S* Racognlza an argumant 


2 


74 


4.11 


0.84 


6. Datarmlna facta/ldaaa 


2 


74 


4.13 


0.85 


7. Idcmttfy alrangth/waaicnaaa 


6 


68 


3.91 


0.87 


9. Racognlza tachniquaa 


9 


59 


3.78 


0.92 


9. Raoogniza aiamanta 


4 


73 


3.98 


0.84 


10. Idantify logical aaaumptiona 


6 


65 


3.81 


0.87 


11. Racognlza point of viaw 


4 


73 


3.99 


0.83 


1Z Parcalva %vlwt la Impliad 




71 


3.98 


0.83 


13* Racognlza attfttida axpraaaad 


4 


66 


3.83 


0.83 


14« Racognlza atyia 




52 


3.58 


0.88 


IS. Distinguish facts/opinion 




77 


4.22 


0.88 


16. Racognlza idaaa/sltuatlona 




65 


3.78 


0.88 


17. Datsrmlna author's purposa 




61 


3.78 


0.92 


18. Undaratand raading saiactions 


4 


74 


4.03 


0.84 


19. Uaa tat;4a of oontants 




95 


4.70 


0.57 


20. Arranga Idaaa in raading salaction 




73 


4.08 - 


0.91 


21. idantify raiationshlpa 




81 


4.18 


0.79 


22. Datarmlna impilad raiationshlpa 




76 


4.05 


0.83 


23. Ljocata piaca In raading salaction 




71 


4.09 


0.97 


24. Racognlza diffarant Intarpratatlona 


3 


78 


4.09 


0.81 


25. Idantify what author aasumas 


7 


65 


3.78 


0.88 


29. Raoognlza maaning of word 


3 


82 


4J{1 


0.81 



*l/H m of imic or no Importanca 
Sf/E ■ vary or axtramaly Important 
•t^N > 20% 
tMaan of iaaa than 3.50 



02 



3EST COPY AVAILABLE 




VJ4 



SUPPLEMENTARY TEACHER RESPONDENTS 
V/E I M— n 



t/N 



28. Understand fuoctk>fvk#y tmntH. 

29. CompM«/ooinb<n« id«M 

30. kkntify Inoonti^itanclM 

31. Specify •PP'opriat* r#f«r«nc« «o«rc« 

32. Underttand TMdlng materiaU 
H. WRmNQ 

33. Daacrtba an avaot/tftuadoo 

34. DaMnaala atapa In a pfocaaa 

35. Support a poaMon 

36. Analyxaldaaa 

37. ProvMa a daar focua 

38. Produoa/davatop aupp. matariala 
30. Organlza Idaaa 

40. Uaa voaalMilary appropriatly 

41. Praaant Waaa In writing 

42. Praaantaltamatlva points 

43. ProdMoa writing fraa of arrora 

44. Raoognlza baalc grammatical arrora 

45. RacognUa affactiva aantanca atructura 
4«. Raoognlza Inappropriate language 

47. Reviae aentenoea 

48. Reviae paragrapha to create 

49. Reviae paragrapha to clarify 



4 

2 
2 
6 

0 
1 



0 

0 

2 

1 

1 

1 

0 

0 

6 

3 

0 

0 

2 

1 

0 

1 

2 



73 I 3.97 

72 4.01 

76 4.01 

71 3.95 

90 4.48 

78 4.11 



91 t 4.45 
94 I 4.52 
64 4.23 
67 4.34 
86 4.26 
83 4U22 

93 4.52 

94 4.53 
66 3.84 
69 X92 
90 4.49 

95 I 4.67 
4.32 
4.27 



85 
64 
95 
88 
66 



4.63 
4.33 
4.29 



a8i 

0.78 
0.87 
0.69 
0.77 



0.65 

0.63 

0.76 

0.72 

0.74 

0.75 

0.64 

0.62 

OM 

0.82 

0.69 

0.58 

0.78 

0.77 

QM 

0.70 

0.74 



Q3 



KLC 



SUPPLEMENTARY TEACHER RESPONDENTS 







L/N 


V/E 


Maan 


S.D. 


M. MATHEMA'nCS 










50* 


R«009nlz« position of numb«i« 


3 


80 


4.27 


0.89 


51. 


R^eognlM •quival^fit forms 


2 


77 


4.21 


0.86 


52. 


Solvo pfoMoms 


4 


76 


4.10 


OM 


53. 


Um •pproprteto form of numbor 


2 


80 


4.19 


0.82 


54. 


Dsmootraf eliaract of counting #*• 


4 


75 


4.13 


0.90 


55. 


intorprvt and apply ratio 


5 


75 


4.00 


0.86 


56. 


Parform oomputationa 


1 


94 


4.60 


0.62 


57. 


Raad/failarprac varloua grapha 


2 


83 


4M 


0.81 


56. 


Raoogniza mimarlcal data 


8 


67 


3.81 


0.90 


59. 


Oamonatrala ability to analyza 


6 


68 


3.86 


0.86 


ea 


Intarprat Moan, Madlan, Moda 


10 


58 


3.65 


0.93 


tel. 


kttarprat Ranga, Varianca, S.D. 


17 


47 


3.39 


1.00 


52. 


Saiact aaquanca of oparatlona 


4 


72 


3.97 


0.89 


t*63. 


Raoo9ni2a ratetionahlpa among vartablaa 


21 


40 


3.28 


1.11 


•4. 


Solva aknpla aquatlona 


7 


79 


4.15 


0.94 


65. 


Wrtta aquatSooa using vaHablaa 


14 


55 


3.57 


1.02 


t 66. 


Raoogniza patiama 


17 


50 


3.49 


1.06 


67. 


Uaa formulaa for da^armlnlng langth 


16 


52 


3.51 


1.05 


66. 


Uaa va/foua aystama of maaauramant 


15 


51 


3.55 


1.05 


69. 


Convart unlta - maaauramant systam 


10 


57 


3.66 


0.95 


70. 


Intarprat logical connactivas 


13 


53 


3.57 


1.01 


71. 


Usa daducdva/lnductfva raaaoning 


15 


57 


3.62 


1.01 


72. 


Draw eorract eonciualona 


16 


^ 


3.55 


0.99 


73. 


Oamonatrata waya to find anawara 


6 


71 


3.94 


0.92 


74. 


Damonatrata fundamantat algorithms 


9 


67 


3.84 


0.99 


t*75. 


Uaa axamplaa from hiatory of math 


36 


28 


2.91 


1.12 



04 



SUPPLEMENTARY TEACHER RESPONDENTS 



L/N 



V/E 



M. MATHEMATICS (eotif«9 
70. ExpTMs iMy oono«fyt of math 
77. Um caletilalor as tool 
79. Um a variety of matMrlala 

Vt USTCMMG 

79. Rocali actual ifvording of mMsaga 

80. Racall * paraphraaa apokan maaaa^a 
•1. Salaet Info. In a apokan maaaaga 

•2. Bacogniza a apaakar'a quaat>»n 

•3. Undaraland knpUad cont In miaaaga 

64. Undaratand maaning of fig. of apaaeh 

85. lntarpcatpufp.of rhatortcaldavica 

86. Racognlza organte-'tpokan maaaaga 

87. Want main Waa of maaaaga^lractty 

88. Want main Waa of maaa^faraWa 

89. Wantify a apaakar'a purpoaa 

90. Racognlia atrangth/waaknaaa In logk5 

91. Datacnilna facta praaantad ara ralav. 

92. Oatannkia atatamanta ara fact/opinion 

93. Wanttfy baaia of Wglcal argumant 

94. Wantrty aaaumptlon of tog. a? gumant 

95. WantHy affactlva/amotkHial eontant 

96. Focua on a apokan maaaaga 

97. Unctoratand oral Inatnictlona givan 

98. Uaa cuaa audi aa pHdi 

99. Racognlza diaiaeta of apokan English 
loa Undaratand apokan Engllah dlalacta 



7 
7 
9 

11 
3 
3 
0 
2 
6 
11 
6 
1 
2 



72 
66 

70 



S.D. 



3.99 
3.92 
4.00 



11 



61 3.76 

84 4.19 

85 4.22 
89 4.43 
80 4.16 

69 3.94 
61 3.69 

70 3.89 
91 4.52 
84 4.20 
82 4.22 
66 3.78 
73 3.97 
77 4.06 
82 4.23 
68 3.83 

62 3.71 
66 3.84 
90 4.48 
79 4.12 
68 3.89 

63 3.75 



0.98 
0.98 
1M 



1.02 

031 

0.76 

aTO 

0.79 

0.90 

0.91 

0.89 

0.69 

0.75 

0.81 

0.84 

0.82 

0.88 

0.81 

0.87 

0.88 

1.02 

0.71 

0.83 

0.94 

1.00 



Q5 



SUPPLEMENTARY TEACHER RESPONDENTS 





L/N 


V/E 


lytoan 


S.D. 


v. SPEMONQ 










101. EnuActelt words 


0 


02 


AM 


0.88 


102. Sp— fc In • fkJftt mannf 


1 


S7 


4.34 


0.74 


103. Sp<ik 1 rut to bm undorttood 


1 


92 


4.47 


0.88 


104. SpMk loudly to iMhMrd 


1 


94 


4JSB 


0.85 


105. Um toM ol volo« to cofiv«y mMMQ* 


2 


87 


4.34 


0.74 


100. PtaM «lr«M approprtetoiy 


2 


85 


4.30 


0.78 


107. Dm •y* oofitool 


2 


91 


4.44 


0.71 


lot. Um gramniatfcal ttnjctura correctly 


0 


94 


4.56 


0.83 


100. Ad|uct gramnurtlcal comptoxily 


3 


88 


448 


0.80 


110. D«fiiOffi«tr«to basic working vocabulary 


1 


93 


4.44 


0.87 


111. Rooognizo mosaago not understood 


0 


94 


4.53 


0.83 


112. Sufiply synonym tor a word 


1 


90 


4JS8 


0.70 


1 1 A MMfVi voQviiwscy WMi viyw Of iwngi 


« 






u.do 


11 A AHlttAt 4a I M ii^i 1 tail f^H^ftnA 












1 
1 


01 




n ao 


iio. opoaK vOfMiwoiy ana w uio poHii 


4 

1 


ai 




U.OV 


1 1 Y * aImiH 11 lilt I liHAfliAfiAn 




ao 
av 
















118. Gat a Hstonor's attantion 


0 


91 


4.52 


0.8^ 


119. GIvo vartMl/non-vorbai faadbaefc 


1 


88 


4.25 


0.72 


120. Exardaa gd. Judgmant-oral intoractton 


1 


89 


4.28 


0.68 


121. Otract vartMM intoractton 


2 


79 


4.12 


0.77 


122. Adapttoa vartot^ of conun. situattons 


0 


83 


4.19 


0.72 


123. Raquast darifloatton of spokan mass. 


1 


91 


4.40 


0.68 


124. Ba awara of Usl^nar's non-vart>al cuas 


1 


81 


418 


a77 


125. Ba awara of ona own non vart>ai cuas 


0 


85 


4.28 


0.72 



06 



12e. RMpond to tIslMiwr't signs 

127. F'^«itohspok«im«M.tosudlsno»lsvsl 

128. Rciryn from Intsmiptkm* 

129. UMm to ipssfcsr and summaHzs id#«t 

131. U«ltn to •om^on* dsscrtb« situatloo 

132. ObtMkt InfofUMrtJoo from dWf. rw)ufc#« 

133. UsiMi to a cIlM. and cvaluato logic 

134. Obaarva/di»cfll>o an Inddont 



SUPPLEMENTARY TEACHER RESPOWDENTS 



L/N 


V/E 


Moan 


S.D. 


0 


91 


4.39 


0.66 


1 


90 


4.32 


Q.6v 


1 


86 


4.29 


0.75 


2 


86 


4.22 


0.72 


5 


72 


3.99 


0.88 


• 


67 


3.79 


0.86 


3 


74 


4.00 


0.81 


2 


81 


4.14 


0.78 


6 


71 


3.92 


0.84 



Q7 

189 



Appendix R 

Su pplementary Teacher Re <;pnndents: Mean Ratines hv Race /Ethnicitv 



ERIC 
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200 









TOTAL 
N>:236 




BLACK 
N»114 


HISPANIC 

N:s122 


REAOMG 


MEAN 




S.D. 


MEAN 


S.D. 


MEAN 


S.D. 


1. 


Dtl»rmlfi8 main Mm 


4.87 




0.58 


4.67 


0.57 


4.67 


0.58 


7. 


Lo<Mrt» important ld««t 


4.55 




0.62 


4.53 


0.63 


4.56 


0.61 


X 


Idaotify accurata paraphraaas 


4.28 




0.78 


4.37 


0.71 


4.20 


0.84 


4. 


Datawnlna aupporting Maaa 


4.34 




0.80 


4.33 


0.80 


4.34 


0.80 


9. 


Raoognlza an argumant 


4.11 




0.84 


4.09 


0.86 


4.13 


0.82 


«. 


Datarmlna facta/ldaaa 


4.13 




0.84 


4.12 


0.82 


4.14 


0.85 


7. 


Waeitify ttrangth/waaknaaa 


X91 




0.87 


3.96 


0.84 


3.85 


0.89 


8. 


Raoognlza taehniquaa 


3.78 




0.92 


3.78 


0.89 


3.78 


0.94 


9. 


Raoognlza tiamants 


3.98 




0.84 


3.90 


0.86 


4.06 


0.81 


lo- 


Idanlify loyicai aaaumptiona 


3.81 




0.87 


3.81 


0.89 


3.80 


0.84 


ll. 


RacoQiilza point of viaw 


3.99 




0.83 


3.91 


0.86 


4.07 


0.80 


1Z 


Pmc9hf% what ia impilad 


3.98 




0.83 


4.01 


0.81 


3.96 


0.86 


IX 


Racogniza attHuda axpraaa4Kl 


3.83 




0.83 


3.86 


0.82 


3.81 


0.85 


14. 


Raoognlza ttyia 


3.56 




0.88 


3.52 


0.95 


3.60 


0.81 


15* 


DIatingulah facta/opinion 


4.22 




0.88 


4.27 


0.80 


4.18 


0.94 


18. 


Raoognlza idaaa/aituationa 


3.78 




0.88 


3.71 


0.85 


3.85 


0.91 


17. 


Datarmlna author's purpoaa 


3.78 




0.92 


X71 


0.92 


3.85 


0.92 


18. 


Undaratand raading aalactiona 


4.03 




0.84 


4.03 


0.87 


4.03 


0.82 


19. 


Uaa taMa of contanta 


4.70 




0.57 


4.74 


0.50 


4.65 


0.63 


20. 


Arranga idaaa in raading talaction 


4.08 




0.91 


4.15 


0.80 


4.01 


0.99 


21. 


IdantHy ralatlonahipa 


4.18 




0.79 


4.19 


0.80 


4.17 


0.79 


22. 


Datarmfna Impliad ralationahipa 


4.05 




0.83 


X99 


0.83 


4.11 


0.84 


23. 


Loeata placa In raading talaction 


4.09 




0.97 


4.09 


0.97 


4.08 


0.97 


24. 


Raoognlza dlffaram intarpr<^tiona 


4.09 




0.81 


4.14 


0.82 


4.04 


0.80 


25. 


Idantify what author aaaumaa 


X78 




0.88 


3.77 


0.89 


3.79 


0.87 


26. 


Raoognlza maaning of word 


4.21 




0.81 


4.24 


0.79 


4.18 


0.83 



-fMMn of l«M ttMn 3JI0 fof oft* or more rotpondtnt subgroups 

R2 

BEST COPY AVAILABLE 

ER?C 201 



I REAOWG (oociTd) 


TOTAL. 




BLACK 


HISPANIC 


MEAN 


S.D. 


MEAN 


S,D. 


MEAN 


S.D, 


27. D«t«nniffM mMnin^ of flgunitk>n 


3.97 


0.64 


3.90 


0.86 


4.03 


0.81 


2S. Understand functlon4i«y transit 


4.01 


0.81 


4.00 


0.80 


4.03 


0.83 


29. Cofnpar«/oombin« tdaaa 


4.01 


0.78 


3.97 


0.77 


4,05 


0.74 


30. Idandfy lnoonaitt«ncl«s 


3.95 


037 


3.93 


0.81 


3.98 


0.92 


31. Specify appropdata rafaranca aourca 


4.46 


0.69 


4.54 


0.66 


4.43 


0.72 


3Z Undarstand raading matariaU 


4.11 


0.77 


4.09 


0.71 


4.12 


0.82 


M. WRtrmG 














33. Daaarlba an avant/sltuation 


4.45 


0.65 


4.41 


0.64 


4.48 


0.67 


34. Da4lnaata ttapa In a procata 


4.52 


0.63 


4.47 


0.67 


4.57 


039 


35. Support a position 


4.23 


0.76 


4.17 


0.73 


4.30 


0.78 


36. Analyzaldaaa 


4.34 


0,72 


4.25 


0.75 


4,42 


0,68 


37. ProvMa a daar focua 


4.26 


0.74 


4.21 


0,73 


4,31 


0,75 


39. Produca/davalop supp. matarlala 


4.22 


0.75 


4.25 


0.74 


4.19 


0.75 


39. Organtza Idaaa 


4.52 


0.64 


4.49 


0,66 


4,55 


0.62 


40. Uaa voealHJiary appropriatly 


4.53 


0.62 


4.48 


0.61 


437 


0.62 


41. Praaant idaaa In writing 


334 


038 


3.83 


0.89 


3.85 


0.87 


42. Praaant altamatlva points 


3.92 


0.82 


3.87. 


0.79 


3.96 


0.84 


43. Produoa writing fraa of arrors 


4.49 


0.69 


4.54 


0.67 


4.44 


0.71 


44. Raoognixa baak grammatical arrora 


4.67 


038 


4.67 


0.59 


4.66 


0.57 


49. Raoognlza affactiva santanca structura 


4.32 


0.78 


4.40 


0.74 


4.23 


0.80 


46. Racogniza Inappropriata language 


4.27 


0.77 


4.25 


0.83 


4J28 


0.72 


47. Ravlaa santancaa 


4.63 


039 


4.58 


0.64 


4.67 


0.54 


46. Raviaa paragrapha to craata 


4.33 


0.70 


4.30 


0.73 


4.35 


0.67 


49. Raviaa paragrapha to clarify 


4.29 


0.74 


4.27 


0.79 


431 


0.69 



R3 



202 







TOTAL 




BLACK 


HISPANIC 


WL MATHEMATICS 


MEAN 


S.D. 


MEAN 


c n 
O.D. 


McAN 


Q n 
o.u. 


SO. 


RMogniM position of numbofs 


4JZ7 


0.59 


4.25 




4.3U 


U.vU 


51. 


Rooognizo •qulval^nt forms 


4.21 


0.55 


4.15 


0.91 


4.25 


A OC 

0.O9 


52. 


Solv* problwnt 


4.10 


0.55 


4.07 


0.50 


4.12 


A AO 

0.92 


S3. 


Um approprtttl* form of numbor 


4.10 


0.52 


4.19 


0.52 


4.19 


A 

0.52 


54. 


DomofistrM eharact of coMOtlng #'s 


4.13 


0.90 


4.14 


0.55 


4.12 


a95 


55. 


UiUrprst and apply ratio 






3.97 


0.55 


4.02 


0.54 


56. 


Porfocm computationa 




a52 


4.55 


0.55 


4.54 


A CA 

0.99 


57. 


Raad/Sntarprat varioua grspha 




0.51 


4.27 


0.52 


4.29 


A AA 

0.50 


sr 


Raoogniza numarical ctata 


3JI1 


0.90 


3.51 


0.89 


3.51 


A AA 
0.90 


58. 


Damonatrala ability to anaiyza 


3.55 


0.55 


3.35 


a9i 


3.53 


0.55 


5a 


tntarprat Maan, Madtan, Moda 


3.55 


0.93 


3.51 


A Aft 

O.vO 


3.00 


U.V 1 


t 51. 


imarprat Ranga, Varianca, S.D. 


3.39 


1.00 


3.37 


0.99 


3.41 


4 A4 

1.01 


52. 


Sslsct taquaoea of oparationa 


3.97 


0.89 


3.95 


0.92 


4.00 


0.87 


t 53. 


Racogniza raiatSonahlpa among variablaa 




1.11 


3.25 


1.10 


3.29 


1.11 


54, 


Solva almpla aquations 


4.15 


0.94 


4.07 


A Aft 


4.22 


U.Va 


55. 


Wrila aquations using variablas 


3.57 


1.02 


3.53 


1.09 


3.D0 


n Oft 


t 55. 


Raoognlza pattams 


3.49 


1.06 


3.45 


1.07 


3.53 


■4 Aft 


57. 


Uaa formulas for datarmlning langth 


3.51 


1.05 




1.00 


3 52 


I.U9 


t 55. 


Usa vaffoua aystams ol maasuramant 


3J$5 


1.05 


Xo4 


A A*y 
0.97 


3.47 


1 .1 1 


59. 


Convart units • maasuramant systam 


3.55 


0.95 


3.57 


a9i 


3.55 


1.00 


t 7a 


Intarprat logical connactivas 




1 .U 1 


3.45 


1.01 


3.65 


1.00 


71. 


Usa daductlva/lnductiva raasoning 


3.52 


1.01 


3.52 


1.04 


3.70 


0.97 


t 72. 


Draw oorract conclusions 




0.99 


3.49 


1.05 


3.51 


0.93 


73. 


Damonstrata ways to find answars 


3.94 


0.92 


3.56 


0.93 


4.02 


0.65 


74. 


Damonatrala fundamantal aigoftthms 


3.54 


0.99 


3.50 


1.01 


3.55 


0.96 


t 75, 


Usa axampfos from history of math 


2.91 


1.12 


3.02 


1.13 


Z52 


1.10 
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M. MATHBiAllCS ^Wfd) 


TOTAL 




BLACK 


HISPANIC 


MEAN 


S.D. 


MEAN 


S.D. 


MEAN 


S.D. 


79. ExpfWM k«y oonc«pt of math 


3.99 


0.98 


3.92 


1.02 


4.06 


0.93 


77. Um caiculalor tool 


3.92 


0.98 


3.80 


1.05 


4.02 


0.90 


79. Um a varioty of matorlals 


4.00 


1.04 


3.91 


1.07 


4.07 


1.02 


Vt LBTEMNQ 














79. Raoall actual wording Of imsMQO 


3.78 


1.02 


3.73 


0.95 


3.79 


1.08 


iO. Roeatt 4- paraphrasa spokan masaaga 


4.19 


0.81 


4.15 


0.77 


4.23 


0.85 


•1. Salaet Info, in a apokan masaaga 


4.22 


0.76 


4.11 


0.82 


4.33 


0.69 


82. Racognlza a spaakafa quattlon 


4.43 


0.70 


4.35 


0.77 


4.50 


0.62 


$3. Undaratand Impliad eont In maaaaga 


4.18 


0.79 


4.13 


0.84 


4.18 


0.74 


•4. Undaratand maaning of ng. of tpaach 


3.94 


0.90 


3.97 


0.93 


3.91 


0.87 


85. Intarprat purp. of rhatork:al davlea 


3.69 


0.91 


3.68 


0.93 


3.69 


0.90 


88. Raoognlza organtz.-tpokan maaaaga 


3.89 


0.89 


3.84 


0.90 


3.93 


0.88 


87. klant main Idaa of maaaaga-dlractly 


4.52 


0.69 


4.37 


0.78 


4.65 


0.56 


88, Idant main Idaa of maaa-lnfarabia 


4.20 


0.75 


4.13 


031 


4.27 


0.68 


88. klantify a apaakar'a purpoaa 


4.22 


0.81 


4.12 


0.87 


4.31 


0.74 


90. Raoognlza atrangth/waaknaaa In logic 


3.78 


0.84 


3.70 


0.83 


3M 


0.85 


91. Dalarmina facta praaantad ara ralav. 


3.97 


0.82 


3.91 


0.82 


4.02 


0J2 


92. Oalarmlna atatamanto ara fact/opinion 


4.06 


0.88 


3.96 


0.93 


4.15 


0.84 


93. kSantIfy baala of logical argumant 


4.23 


0.81 


4.18 


0.84 


4.28 


0.78 


94. Mantify aaaumption of log. argumant 


3.83 


0.87 


3.75 


0.93 


3.91 


0.80 


95. Mantlfy affactlva/amotional contant 


3.71 


0.88 


3.57 


0.93 


3.85 


0.81 


96. Fooua on a apokan maaaaga 


3.84 


1.02 


3.78 


1.01 


3.90 


1.03 


97. Undaratand oral Inatructiona givan 


4.48 


0.71 


4.46 


0.67 


4.49 


0.75 


98. Uaa cuaa such aa pitch 


4.12 


0.83 


4.06 


0.84 


4.18 


0.82 


99. Raoognlza dialacta of spokan Engllah 


3.89 


0.94 


3.91 


0.91 


3.87 


0.98 


100. Undaratand apokan English dialacu 


3.75 


1.00 


3.80 


0.99 


3.70 


1.02 



R5 



V. 8PEAKIKIG 


TOTAL 




BLACK 


HISPANIC 


MEAH 


S.D. 


MEAN 


S.D. 


MEAN 


S.D. 


101. EnunolM words 


4.50 


0.66 


4.46 


0.70 


4.53 


0.62 


102. SpMk 111 a flu«nt mann#r 


4.34 


0.74 


4.40 


0.75 


4.29 


0.72 


103. SpMk at rata to b« understood 


4.47 


0.66 


4.44 


0.68 


4.50 


0.65 


104. Spaak loudly to bo tmrd 


4.55 


0.65 


4.56 


0.64 


4.55 


0.66 


105. Uso tono of voico to convoy mossago 


4.34 


0.74 


4.32 


0.70 


4.36 


0.78 


105. Pteoo siross appropriatsly 


4.30 


0.76 




0.71 


4.24 


0.80 


107. Uso oyo oontaet 


4.44 


0.71 


4.42 


0.73 


4.46 


0.70 


106. Uso grammatical stnicturo corroctly 


4.56 


0.63 


4.59 


0.62 


4.53 


0.63 


100. Ad|ust grammatical comploxity 


4.36 


0.80 


4.33 


0.86 


4.39 


0.74 


110. Domonstrato basic working vocabuUry 


4.44 


0.67 


4.43 


0.69 


4.44 


0.66 


111. Rocognlzo mossago not undorstood 


4.53 


0.63 


4.47 


0.68 


4.58 


0.57 


112. Supply synonym for a word 


4.38 


0.70 


4.29 


0.75 


4.45 


0.65 


113. Adapt vocabulary and stylo of lang. 


4.49 


0.68 


4.43 


0.79 


4.55 


0.56 


114. Adjust to unoxpoetsd ehango 


4J22 


0.79 


4.20 


0.85 


4.25 


0.73 


115. Uso spokon lang. for varloty of purp. 


4.43 


0.69 


4.35 


0.73 


4.50 


0.65 


116. Spoak ooncisoly and to tho point 


4.44 


0.69 


4.46 


0.68 


4.42 


0.69 


117. Road aloud wHh intonation 


4.39 


0.75 


4.42 


0.75 


446 


0.74 
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118. Got a Ustonor's attontion 


4.52 


0.67 


4.55 


0.66 


4.48 


0.68 


119. GIvo vorbal/non-vsrbai foodback 


4.25 


0.72 


4.23 


0.77 


4.26 


0.67 


120. Exorclso gd. iudgmont-oral Intoraction 


4.28 


0.68 


4.29 


0.69 


4.28 


0.67 


121. Diroct vorbal Intoraction 


4.12 


0.77 


4.09 


0.74 


4.15 


0.81 


122. Adapt to a varioty of comm. situations 


4.19 


0.72 


4.19 


0.71 


4.18 


0.72 


123. Roquost clarification of spoksn moss. 


4.40 


0.68 


4.32 


0.72 


4.48 


0.62 


124. Bo awaro of Ustonor's non-vorbal cuos 


4.16 


0.77 


4.12 


0.80 


4.20 


0.75 


125. Bo awaro of ono own non-vortial cuos 


4.28 


0.72 


4.19 


0.73 


4.36 . 


0.70 



R6 



2Gb 



VL INTOIMrTIVCCOMMUNXIAT^ 

12& RMpond to lttt«n«r't Signs 

127. Match spoksn ms«s, to sudUoo^ Isvsl 

12S. R«fraln from tntsmiptions 

129. Ustsn to spoakor and summartzs Idsss 

13a Ustso to tw»o spaaksrs and compara 

131. Ustan to somaona dascrlba situation 

132. OWaIn Information from diff. raaourcas 

133. Uatan to a disc snd avaluata logic 

134. Obsarva/daacrtba an Incident 



TOTAL 


BLACK 


HISPANIC 


MEAN 


S.D. 


MEAN 


S.D. 


MEAN 


S.O. 


4^ 


0.66 


4.35 


0.67 


4.42 


U.DO 


4.32 


0.69 


4.32 


0.71 




0.67 


4J29 


0.75 


4.32 


a73 


AM 


0.76 


AJ22 


0.72 


4.15 


0.73 


4.28 


0.70 


3,CS 


0.88 


3.89 


0.85 


4.00 


0.90 


3-79 


0.86 


X75 


0.88 


3.82 


0.85 


4.00 


0.81 


3.95 


0.83 


4.05 


0.79 


4.14 


0.78 


4.12 


0.82 


4.15 


0.75 


3.92 


0.84 


3.85 


0.85 


3.96 


0.83 
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